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(57) Abstract 

A method of in situ analysis of a biological sample comprising the steps of (a) staining the biological sample with N stains of which 
a first stain is selected from the group consisting of a first immunohistochemical stain, a first histological stain and a first DNA ploidy stain, 
and a second stain is selected from the group consisting of a second immunohisjochemical stain, a second histological stain and a second 
DNA ploidy stain, with provisions that N is an integer greater than three -and further that (i) if the first stain is the first immunohistochemical 
stain then the second stain is either the second histological stain or the second DNA ploidy stain; (ii) if the first stain is the first histological 
stain then the second stain is either the second immunohistochemical stain or the second DNA ploidy stain; whereas (iii) if the first stain 
is the first DNA ploidy stain then the second stain is either the second immunohistochemical stain or the second histological stain; and (b) 
using a spectral data collection device for collecting spectral data from the biological sample, the spectral data collection device and the N 
stains are selected such that a spectral component associated with each of the N stains is collectable. 
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IN SITU METHOD OF ANALYZING CELLS 



FTRT.D AND BACKGROUND OF THE INVENTION 

The present invention relates to in situ analysis of cells and, more 
5 particularly, to simultaneous in situ analysis of a plurality of 
immunohistochemical stains, histological stains and/or DNA ploidy stains 
using spectral imaging techniques, which enable high spatial resolution as 
well as spectral resolution. 

Over the past ten to fifteen years, immunohistochemistry (IHC), 
10 which is also known as immunocytochemistry (ICC) when applied to cells, 
has become an indispensable tool in diagnostic pathology and has virtually 
revolutionized the practice of surgical pathology. The terms 
immunohistochemistry and immunocytochemistry are used herein 
interchangeably. Panels of monoclonal antibodies can be used in the 
15 differential diagnosis of undifferentiated neoplasms (e.g., to distinguish 
lymphomas, carcinomas, and sarcomas); to reveal markers specific for 
certain tumor types; to diagnose and phenotype malignant lymphomas; and 
to demonstrate the presence of viral antigens, oncoproteins, hormone 
receptors, and proliferation-associated nuclear proteins. Not only do such 
20 markers have diagnostic significance, but there- is a growing body of 
evidence that some tumor markers have prognostic significance, as has been 
most extensively demonstrated in breast cancer. These marker studies can 
be performed by IHC on a variety of specimen types, including cytological 
preparations, paraffin-embedded tissue, and frozen sections. Most clinical 
25 assays employ a single antibody for each slide but by using chromogens of 
different colors, it is possible to observe/demonstrate two or more markers 
simultaneously. However, without the use of equipment for processing the 
appropriate spectral resolution the qualitative or quantitative detection of 
these chromogens is difficult due to the fact that their absorption 
30 coefficients spectrally overlap. 

For most applications of IHC, qualitative assessment of the staining 
patterns is sufficient, because it is the overall staining pattern of the tissue 
and the cells of interest that imparts the diagnostic information. The human 
visual system is quite adept at such pattern-recognition tasks, which can be 
35 performed quite rapidly, although subjectively. However, the human, eye or 
a CCD camera are not at all adapted at high spectral resolution. However, 
there are certain markers for which image analysis could play an important 
role. These include detection of hormone receptors, tumor proliferation 
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markers, oncoproteins, tumor suppressor gene products (e.g., p53), 
chemotherapy resistance factors, tumor angiogenesis, lymphocyte subset 
analysis, etc. 

The general goal of quantitative IHC (QIHC) is to provide objective 
measurements of immunostaining reactions. These measurements may be 
useful in data collection for experimental purposes, but the greatest 
potential of such measurements lies in exploring their use as aids for 
determining diagnosis, prognosis, or therapy of human disease, especially 
cancer. Aside from the mechanics of making such measurements, which 
will be discussed, a number of issues are related to the peculiarities of IHC 
which potentially affect how the measurements should be made. 

Many of the biological markers detected by IHC do not exhibit a 
simple "all-or-none" type of expression, and the cellular populations being 
studied may exhibit considerable heterogeneity with regard to pbsitivity and 
degree of staining. The localization of the staining reaction may also be 
important, because some antigens can be expressed on the plasma 
membrane, in the cytoplasm, or in the cell nucleus. Therefore, both the 
distribution of the marker among the cell populations and subcellular 
localization need to be taken into account. 

Unlike immunostaining using directly fluoresceinated antibodies, in 
which the degree of staining is related to ligand concentration in a linear 
fashion, IHC is in theory nonlinear for two reasons: (i) the enzyme reaction 
forming the precipitation reaction product is nonlinear, and (ii) a variety of 
• amplification strategies are typically employed, using either bridging or 
complexing reagents, the goal being to increase the staining sensitivity. The 
result is that the amount of antigen cannot be directly calculated from the 
intensity of the immunohistochemical staining. In addition, there may be 
substantial day-to-day variation in the quality of immunostaining, although 
automation of the staining procedure may provide more consistency than is 
usually obtained using manual methods. 

Some studies, however, do indicate that under certain conditions it 
may be possible to establish a linear relationship between ligand 
concentration and degree of immunohistochemical staining, mostly 
demonstrated using model systems [van der Ploeg M, Duijndam WAL. 
Matrix models: Essential tools for microscopic histochemical research. 
Histochemistry 1986; 84:283]. It has been suggested that the biotin-avidin 
method of staining may be less suitable for this purpose than the 
peroxidase-antiperoxidase method, because the former suffers from high 
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sensitivity for low concentrations of antigen and poor dynamic range, due to 
steric hindrance at higher antigen concentrations. Rahier et al. [Rahier J, ► - 
Stevens M, de Menten Y, Henquin J-C. Determination of antigen 
concentration in tissue sections by immunodensitometry. Lab Invest 
5 1989;61:357-363], studying insulin concentration in rat pancreatic islet 
cells, were able to show excellent correlation between radioimmunoassay 
and QIHC using image analysis. They make the important observation that 
using lower concentrations of antibody is key to the success of the method, 
because higher concentrations of antibody failed to exhibit a linear 
10 relationship with insulin content. They also point out that higher 
concentrations of antibody should be used when the goal of the 
measurement is to detect all cells containing the antigen of interest, 
regardless of level. However, even higher spectral sensitivity is required 
when working at lower level of antibody, especially if multiple antibodies 
1 5 are to be simultaneously employed. 

It is clear that any attempt to quantitate the intensity of 
immunostaining requires the use of calibration standards, possibly cell lines 
expressing known levels of antigen or some kind of internal reference. 
These problems need to be addressed in each application of QIHC. 
20 The approach that has been used most commonly in QIHC relies on 

the measurement of population statistics, such as the percent of positively 
stained cells, rather than absolute biochemical concentration of the target 
molecules. This approach is analogous to that used in clinical flow 
cytometry, where the proportion of a cell population expressing a given 
25 surface marker, rather than the level of expression of that marker, is most 
commonly measured. 

For many of the markers of interest, such an approach makes a great 
deal of sense biologically. For example, if one is interested in the 
expression of cell cycle-related markers, it is the proportion of cells 
30 expressing that marker, rather than the absolute level of expression, which 
provides information about the proliferative fraction. 

For some markers, such as hormone receptor measurement in breast 
cancer, the standard methods have provided a biochemical determination 
expressed as concentration. However, tomurs may -exhibit striking 
35 heterogeneity with regard to expression of these molecules, and 
measurements that reflect this heterogeneity may provide information that is 
more biologically relevant. After all, two tumors may exhibit identical 
biochemical levels of a given molecule and yet have very different 
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proportions of tumor cells that actually express any level at all. This 
problem is perhaps best illustrated with regard to estrogen receptor . 
measurement in breast cancer. 

The ability to measure immunohistochemical reactions in tissue 
sections or cytological preparations is highly dependent on the choice of 
staining and imaging methods. The levels of immunostaining (signal) must 
be detectable above the background (noise), and should be distinguishable 
from other cellular or tissue features. In IHC, this is standardly addressed 
by carefully titering the antibodies (primary and secondary) to maximize the 
specific staining and minimize the background staining. The tissues are 
visualized using histological stains (also known as counterstains) having a 
different color than the chromogen, so that the staining reaction can be 
easily visualized. For example, immunoperoxidase reactions, which yield a 
brown reaction product, are typically combined with methyl green or 
toluidine blue histological stains (counterstains) to provide visual contrast. 
However, when multiple immunohistochemical stains of different label are 
used in combination with histological stains and/or DNA ploidy stains it is 
advantageous to be able to distinguish among the marker stains themselves 
and to further distinguish between the different stains used for 
counterstaining or for examination of DNA ploidy, such that each spectral 
component is identifiable independently of the other spectral components. 
This cannot be achieved according to any of the methods known m the pnor 

art. . 

Although some image analysis systems employ true color analysis to 

measure specific regions of the color spectrum, most imaging systems are 
based on a gray scale (black and white) light measurements, and depend on 
optical filters to select specific wavelengths of light for measurement. 
Combinations of stains that show minimal spectral overlap are presently 
most useful for QIHC. However, a system with increased spectral 
) resolution will-enable the use of highly overlapping dyes. 

The CAS 200 System (Cell Analysis Systems, Inc., Lombard, 111.), 
employs two video cameras, one coupled with a 500 nm bandpass filter and 
the other with a 650 nm filter. Tissues are immunostamed usmg the 
immunoperoxidase method with diaminobenzidine (DAB) as the 
,5 chromogen (brown reaction product) and methyl green as the tissue 
(nuclear) counterstain. Images of the nuclei of all of the cells in the field 
are captured by one camera using the 650 nm filter, while the other camera 
captures images of the brown reaction product at 500 nm, a wavelength at 
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which DAB is maximally transmitted and methyl green is absorbed. The 
optical density of the reaction product can be determined by conv^ng the . 
light transmission (gray level) to optical density using a calibrated look-up 
table, and the relative area of the staining reaction (expressed as a percent of 
the area stained by methyl green) can be calculated. Simple thresholding 
methods are used to establish the gray levels for capturing the cell nuclei 
and for setting the lower limit for detection of DAB, based on a slide 
stained with control antibody. Combinations other than methyl green and 
DAB may be used, restricted only by the spectral overlap of the reagents 
and the availability of suitable filter combinations. This system, however, 
has an inherent limitation. It can only detect two spectrally non-overlapping 
spectral components. A system with a higher spectral resolute would 
enable to simultaneously detect a plurality of spectral components, with 
hieher spectral overlap thereamongst. 

No standards have yet been established in the field of Q1HC with 
regard to instrumentation, computer algorithms, staining methodology, or 
performance characteristics (precision, reproducibility) [Wells WA Rainer 
RO Memoli VA. Equipment, standardization, and applications of image 
processing. Am J Clin Pathol 1993; 99:48-56]. Such standardization has 
been difficult to achieve in another technically related area, flow cytome^ 
although there has been progress [Muirhead KA. Establishment of quality 
control procedures in clinical flow cytometry. Ann NY Ac ad Sa J993. 
677 1-20; and National Committee for Clinical Laboratory Standards^ 
Clinical applications of flow cytometry: Quality assurance and 
S immunophenotypins of peripheral blood ^^ ! n ^^^ 
Villanova: NCCLS; 1992; NCCLS document H42-T (ISBN 1-56238-15.5- 
5)1 Standardization issues important for clinical laboratory testing 
including the precise antibodies and chromogens to be used, the number of 
fields and tissue sections to be measured, the units used to report results, 
l0 quality control materials, and instrument calibration have not yet been 
resolved for QIHC As will become apparent to the reader, the present 
invention provides a giant step towards such standardization. 

There is a growing body of evidence that tumor cell proliferation has 
prognostic significance for a variety of commonly occurring ^anci^ 
35 including lymphoma [Braylan RC, Diamond LW, Powell ML, Harty-Golder 
B Percentage of cells in the S phase of the cell cycle in human lymphoma 
determined by flow cytometry: Correlation with labeling >dex and paUen 
survival. Cytometry 1980; 1:171-174; and Bauer KD, Merkel DE, Winter 
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IN etal. Prognostic implications of ploidy and proliferative activity in 
Itse >arge Z lymphomas. Cancer Res 1986; ' 
cancor [Clark GM, Dressier LG, Owens MA, Pounds G Oldaker T, 
MeGuire WL. Prediction of reiapse or survival >n patients wfc node- 
negative breast cancer by DNA flow cytometry. N Engl J Med 1989, 
320-.627-633; Silvestrini R, Daidon. MG, Gasparini G. Ce 1 i kmeta , « 
prognostic maraer in node-negative breast cancer. Cancer 1985; 561982- 
\ 9 87^ and Sigurdsson H, Baldetorp B, Borg A, et al. Indicate n .of 
ptosis in node-negative breast cancer. N Engl J ** 199* 322:1045- 
1053L and coton oanoer [Baner KD, Lincoln ST, Vera-Roman JM, et al. 
Agnostic indications of proliferative activity and DNA anenplotdy » 
colonic adenocarcinomas. Lab Invest 1987; 57:329-335]. In some stod.es 
.umor cell proliferation has independent prognostic 
total DNA content analysis ("ploidy") does not [Vtsscher DW, Zarbo RJ, 
,5 Greenawald KA, Crissman JO. Prognostic significance of n^holog^ 
parameters and flow cytometric DNA analysis in earcnoma of the breast. 
Pathol Ann 1990; 25(Part-I): 171-210]. 

Mitotic counts are generally regarded as a poor and unreliable 
measure of proliferation; yet they require no special preparative 

Uptake of radiolabeled thymidine, or "thymtdtne labeltng ntdex 
(TLI) is a well-established method and is considered by many • * be the 
•■gold standard" for measuring tumor cell kinetics. Although the TLI 
provides an accurate assessment of S-pbase activity and perm.ta hrstologrc 
correlation, tire method is cumbersome and not easily adapted to the olmreal 
» laboratory^ ^ ^ ^ ^ ^ (0 determine oeU 

cycle activity, primarily by quantitation of the S-phase portion of the DNA 
content analysis ("ploidy"). This metttod suffers front a number of serums 
technical limitations, however. First, it may be difficult to obtam single eel 
„ suspensions from solid tumors, and variable numbera of tumor ^Us may be 
l0 at during preparation. Second, the tumor cells are vanably diluted by 
benign normal and inflammatory cells, which can lead to underestimation of 
the S-phase Auction, particularly for DNA diploid tumors. Third, the 
complexity of tire DNA content analysis ("ploidy"), whteh constats _of a 
35 serf* of overlapping curves, may preclude the accurate use of »rve-fimng 
algorithms to measure the S-phase portion of the histogram. Mulhcen. 
studies have shown poor reproducibiUty for flow-cytometitc S-phase 
fraction, making tite practical clinical usefulness of the measurement 
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somewhat doubtfuL Another problem associated with cell kinetic 
measurement by flow cytometry is that only the S-phase frachon is typjcaUy , 
determined, whereas a significant proportion of the tumor ce 1 populahon 
may reside in the G, phase of the cell cycle, compnsed of cells comnntted 
5 to entering the cycle but not yet synthesizing DNA. Concewably, two 
tumors may have identical S-phase fractions but differ 
total fraction of cells in the nonresting state, and thus may exhibit different 
growth kinetics and response to cycle-dependent chemotherapeutic agents. 
For all of these reasons, in situ methods of tumor cell cycle analysis 
10 may provide more biologically meaningful information than can be 
obtained using disaggregated tumor cells [Weinberg I. S. Relative 
applicability of image analysis and flow cytometry in clinical medicine In. 
Bauer KD, Duque RE., eds. Flo* cytometry: Principles and apphcaUons^ 
Baltimore: Williams and Wllkins; 1992:359-372; f ™* °^ 
l5 Proliferation indices in solid tumors. Adv Pathol Lab Med 1992,5.163- 
191] In addition to guaranteeing that the acquired measurements are made 
specifically on the tumor cells, in situ methods can allow more widespread 
sampling of the tumor and determination of tumor cell heterogeneity. 

The quantitation of nuclear DNA is increasingly coming into pracuce 
20 in both research and clinical applications. ^ . 

The measurement of DNA content by either flow or image cytometry 
is based on the assumptions that the amount of stain represents the amount 
of DNA and that this amount of stain is correctly measured by the 
Jstrument. These assumptions would imply that (i) the DNA labdlmg 
25 procedure (fluorescent dye, chromogenic reaction or staining) is specific (al 
DNA is labelled and only DNA), stoichiometric (staining intensity changes 
proportionally to DNA content) and stable (staining intensity does not 
change with time or repeated measurements); (ii) the instrument used to 
measure either the light emitted by the fluorescent dye or absorbed by the 
30 stain is accurate (giving a result close to the true amount of sta^n) and 
reproducible (giving very similar measurements when repeated on the same 
nucleus), even though not close to the true amount of stem, and linear 
(giving a result that is perfectly proportional to the amount of stain). 

Unfortunately, both the staining procedures and prior art instruments 
35 have well-known limitations such that the final measurement is not 
representative of the absolute amount of DNA actually present in a nucleus. 
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While stoichiometry can easily be verified by routine controls, the 
specificity is not accessible because there is no alternative method for the > 
cytometric measurement of DNA content at the individual cell level 
' For example, (i) very specific fluorescent dyes bind to either G-C 
(eg., mithramycin, chromycin A3) or A-T (e.g., Hoechst, DAPI) DNA base 
pairs and thus detect the DNA only partially and generate measurements 
that depend on base pair sequences; (ii) the chromogenic reactions, like 
Feulgen, involve an acid hydrolysis that removes some DNA fragments as 
rapidly as they are released from the decondensed chromatin. These 
reactions thus detect the DNA only partially and provide measurements that 
depend on the euchromatin versus heterochromatin balance; (Hi) the fixative 
medium may impair or facilitate further hydrolysis, depending on the way 

they interact with histones. 

As far as image cytometry of Feulgen-stained nuclei is concerned, 
the Beer and Lambert laws do not perfectly apply since (i) the lineanty of 
stain to optical density (OD) is progressively lost as OD runs over 1 _ unit, 
which is often the case for heavily stained heterochromatin; (u) the 
distribution of the dye is not spatially homogeneous and thus introduces a 
distributional error that increases as the pixel size increases over from the 
resolution power of the optics; (iii) the absorption coefficient of a dye vanes 
with the wavelength of light so that the densitometric calculation only 
applies for monochromatic light. Since they do not deliver enough intensity 
for visual observation (unless combined with huge arc lamps) 
monochromators are not used in routine image cytometry, but filter are used 
; whose centre on the maximum absorption is ±10 nm, which usually vanes 
from one system to another. 

In addition to the above considerations, the preparation and the pnor 
art instruments employed are optical compromises and are thus responsible 
for reflection, refraction and diffraction due to the glass slide, mounting 
o medium, lenses and prisms. The light not following the expected 
geometrical pathways contributes to glare, also called Schwarzchild - 
Villiger effect, which distorts the ratio between the light beam intensity 
incident to the nucleus and that emerging from the specimen. Therefore, all 
the pixel 0D S calculated are slightly erroneous. This error increases as the 
optical field size increases. The use of a high-quality microscope is thus 
mandatory to decrease this systematic error of densitometric measurements, 
which is the most important factor contributing to variations of image 
cytometry measurements. 
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Also, video cameras ere sensitive to vibrations and electromagnetic 
fields, image afterglow and saturation-a.1 factors contributmg to he . 
distortion of the signal before dilation. At present, ^charge ~™pled 
device (CCD) cameras undoubtedly provide the most reproduce results as 
far as densitometry is concerned. .. . 

The above limitations all contribute to negative errors tha have been 
extensively investigated. It is thus obvious that tire tine eel, ™»£ 
no. accessible to cytometric measurements. It . therefore 
some commercially available image cytometry . 
m easuremen<s expressed in picograms DNA per nucleus .thus addntg to the 
"nera. confusion and, in addition, deliberately mis.ead.ng me clnucans 

™ S %t%Tl staining and measuring procedures are correctiy 
performed and controlled, the quantitation of DNA-specific stains can be 
interpreted in terms of overall proliferative activity and 
abeLons, thus giving a clear indication as to how to proceed H*ta ■* 
investigating tirose tumour characteristics that are of mterest for dtfferential 

t m td chromogenic reacts for quantity staining* 

DNA have been recommended in me literatere (see Table 1), bn finally 

only one of them has gathered world-wide acceptance for DNA 

^photometry, and this is the reaction named after Feulgen a£ 

R^enbeoK, often simply named Feu.gen reaction. Stnctly speatan , th 

Feulgen reaction is not a stain but a chromogemc reaction Terms take 

, Sen stain and Feulgen reaction is presently me — 

^clisstoichiometricforDNAwhichmeansmatstarnrngofDNAsboth 

quantitative and specific. All the other methods menboned rn Table 1 are 
quantitative but no. specific for DNA. Tire success of me Feulgen reacbon 
for quantitative DNA staining is certainly based on this uniqueness 

,„ The Feulgen reaction is a complicated cytohiatochemrcal metitod 

which consists of various preparatory steps". Principal.,, tire ration sterts 
with a procedure called acid hydrolysis: slides with the fixed oytelogtoa 
malalare immersed in hydrochloric acid (HC.) which spins off the punne 
Tases adenine and canine from tire DNA molecule, mereby generebng 

35 aldehyde groups in tire pnrine-fiee DNA molecule, whtch ^ then — 
apurinic acid (APA). In a second step, me shdes are numbed m Setoffs 
reagent containing a dye which binds covalently to the aldehyde greup. 
After removal of surplus dye the slides are dehydrated and mounted as 
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usual In correctly stained material, cell nuclei are stained red-violet, and 
the cytoplasm and background are unstained. The various steps of the 
Feulgen reaction become critical when they must be standardized to achieve 
good reproducibility of staining performance. Therefore, a discussion of the 
relevant preparatory steps must consider potential sources of error. 

Table 1 

Quantitative DNA stains (+ , yes; /, no) 



Staining 
procedures 



Quantitati 
ve 



Stoichiomet 
ric 



Feulgen reaction 

(basic fuchsin) 

Feulgen reaction 

plus 

Anionic 

counterstain 

Thionin, 

Feulgen 

Thionin, 

Feulgen 

plus 

Anionic 

counterstain 

Gallocyanin 

chromalum 

Methyl 

green-pyronin Y 
Thionin 
alcoholic 
Victoria blue B 
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Routinely, HC1 is used for acid hydrolysis, but in principle any acid 
is suitable. The acid has two effects on the DNA molecules: (i) removal of 
purine bases, which generates aldehyde groups in the DNA molecules; and 
(ii) depolymerization of the large APA molecules into smaller fragments. 
These fragments are partly removed from the cell nuclei by diffusion into 
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the acid solution. Generation of aldehyde groups leads to an increase in 
nuclear staining intensity, whereas the loss of APA fragments leads to a loss , 
of stainable material from the cell nucleus and thus to a decrease of staining 
intensity. Thus, we have two counter-current chemical reactions, each 
following specific and complicated kinetics; the resulting reaction curve is 
called the hydrolysis profile or the hydrolysis curve. 

This hydrolysis profile can be subdivided into four phases: (i) 
increase of staining intensity; (ii) peak phase with maximum staining 
intensity; (iii) plateau phase with constant staining intensity; and (iv) 
decrease in staining intensity. 

Phase (i) is characterized by continuous generation of aldehyde 
groups. The loss of APA fragments is minimal in the beginning, and the 
amount of stainable material in the cell nucleus increases constantly until 
phase (ii) is reached. The peak can be so short that it is sometimes hardly 
visible in hydrolysis profiles. During the plateau phase, (iii), one finds a 
balance between the continuous generation of aldehyde groups and the loss 
of APA fragments, and consequently, the staining intensity remains 
constant over a certain period of time. In phase (iv) the loss of APA 
fragments outruns the generation, of new aldehyde groups, and the staining 
intensity decreases. After prolonged hydrolysis we find the generation of 
the maximum number of aldehyde groups, but all APA fragments have been 
removed from the cell nucleus, and staining intensity is zero. 

In practice, it is important to stop acid hydrolysis during phase (iii) 
where smaller variations of the hydrolysis time have virtually no influence 

on staining intensity. 

The shape of the hydrolysis curve is influenced by several factors, 

only some of which can be standardized. 

Highly condensed DNA is less sensitive to acid hydrolysis than 
decondensed DNA: phases (i) and (iv) are less steep, and the plateau phase 
is retarded. DNA compactness, as a biological characteristic of cells, vanes 
between different cell types and in the same cell during the cell cycle. Cell 
preparation techniques such as specimen sampling and especially fixation of 
the material may artificially influence DNA compactness and thus acid 
sensitivity. 

A high temperature of the acid bath shortens all four phases. Phase 
(iii) may be as short as only a few seconds, and a prominent plateau may not 
be detectable. If hydrolysis is topped in the very steep phases (i) or (iv), 
even minimal variations of processing time lead to considerable variations 
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in staining. Short hydrolysis profiles with an extremely short peak phase are 
usually found with so-called hot hydrolysis techniques using an acid bath at ► 
60 °C, and frequently it is impossible to stop hydrolysis at the right 
moment, namely in phase (iii). More frequently, cold hydrolysis with 4-5 
mol/1 HC1 is performed at about 22 °C where under routine conditions the 
plateau phase has a length of several minutes. Acid hydrolysis is then 
stopped by a short rinse of the slide in tap water. 

Various additives to the acid bath have been recommended in the 
literature, these should minimize the loss of APA fragments from the cell 
nucleus. These additives, however, do not play an important role for 
practical purposes. 

Setoffs reagent is a colourless aqueous reagent which contains a dye 
mixture called basic fuchsin. Basic fuchsin is normally composed of four 
canonic triarylmehine dyes pararosanilin and its methylated homologues 
rosanilin, magenta II and new fuchsin. Basic fuchsin of high quality 
contains a high proportion of pararosanilin. Schiff s reagent is colourless 
because the relevant dyes are present in their leucoform with sulphite bound 
to the dye molecules. Coloration of Schiff s reagent (based on basic 
fuchsin) proves loss of sulphite and .deterioration of. the solution, which 
should then be discarded. Various substitutes for basic fuchsin have been 
recommended, among them the thiazine dye thionin. The advantage of 
thionin is that it stains cell nuclei blue, a color the cystologists and 
pathologists are used to when they want to check the slide visually), and 
cytoplasmic counterstaining with eosin Y or Congo red is easily feasible. 
Schiff s reagent based on thionin is usually not completely colourless. 

After staining with the Schiff s reagent the material is rinsed in dye- 
free sulphite water. The sulphite removes surplus dye from the cell nuclei 
and cytoplasm, and only the covalently bound dye molecules stay fixed to 
the APA molecules within the cell nucleus. The background of the slide 
should be completely unstained when the Feulgen reaction has been 

performed correctly. 

Acid hydrolysis is the most critical step of the Feulgen reaction. A 
correctly performed hydrolysis should be stopped in the plateau phase. It is 
important to have HC1 of suitable molar concentration at the right 
5 temperature (e.g., 5 moVl HC1 at 22 °C or 4.0 mol/1 HC1 at 27.5 »C). Acid of 
suitable molar strength is commercially available or can easily be prepared 
from concentrated HC1. Frequently, HC1 stored in the refrigerator at 4 °C is 
used immediately without waiting for the acid to warm up; this leads to 



WO 00/06774 PCT/US99/16629 

13 

retardation of the hydrolic reaction, which is often stopped before the 
plateau phase is reached. The use of temperature-controlled water baths is 
recommended. Where this is not feasible, scrupulous measurement of the 
temperature of the acid solution helps to avoid erroneous photometric 
results. 

It is of utmost importance to note that changing the fixative may 
influence the hydrolysis profile dramatically (by changing chromatin 
compactness and thus acid sensitivity of the DNA). Changing the fixative 
means that the hydrolysis curve has to be re-evaluated. Therefore, it seems 
a good recommendation to stick to one staining protocol which has been 
established in the relevant laboratory and was found to give reliable and 
consistent staining results. 

The staining procedure itself is uncritical. Staining should be carried 
out for at least 45 minutes to give the reaction sufficient time to be 
completed. SchifFs reagent of high and consistent quality is commercially 
available. 

Gallocyanin cromalum (GCA) is a cationic oxadine dye which forms 
complexes with metals. GCA stains DNA and RNA quantitatively. Thus, it 
is not specific for DNA. Photometric determination of DNA requires either 
photometric correction for stained RNA or enzymatic or hydrolytic removal 
of RNA. The Einarson GCA staining protocol prescribes staining times of 
up to 48 hours at elevated temperature which makes it impossible to use for 
routine cytology. A modified GCA was proposed by Husain and Watts 
with staining times of about 15 minutes. 

As compared with Feulgen, GCA after Husain and Watts has the 
following advantages: (i) no acid bath; (ii) staining time only 15 min; and 
(iii) gray-blue cell nuclei. The disadvantages are: (i) not specific for DNA; 
(ii) background staining (due to RNA); and (iii) short shelf-life of the 
staining solution (about 6 weeks). Specificity of staining can be improved 
by mild hydrolysis (1 mol/1 HC1 at 22 °C for 10 minutes) which removes 
RNA but not DNA. Anionic counterstaining is possible without loss of 
GCA from the stained DNA. 

GCA stains both wet and dry fixed material. Dry fixed slides are 
significantly less intensely stained. Ethanol 99 % (v/v) for 10 minutes on 
wet fixed material or neutral buffered formaldehyde 3.7 % (v/v) for dry 
fixed material are suitable fixatives. If commercial spray fixatives 
containing polyethylene glycol (PEG) are used, the PEG film on the slide 
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has to be removed prior to staining by washing the slide for 5 minutes in 
ethanol 99 % (v/v). 

Both techniques - the Feulgen reaction and GCA - are equally 
suitable for cytophotometric determination of DNA. However, they give 
completely different results when the texture of nuclear chromatin is 
measured at high optical resolution: acid hydrolysis changes the chromatin 
structure dramatically, and the chromatin texture of Feulgen-stained cell 
nuclei is absolutely different from the texture of GCA-stained material. 

GCA is all in all less critical than the Feulgen reaction and easier to 
perform. Nevertheless, the authors prefer the Feulgen reaction due to its 
substrate specificity and the stability of the staining solution. A careful 
standardization of the protocol, however, is a prerequisite for consistent 
staining quality. 

A variety of monoclonal antibodies directed against cell cycle-related 
nuclear antigens are commercially available and may be used for 
immunohistochemical staining of tissues and cells. The number of 
publications resulting from studies on human tumors using these antibodies 
is exponentially increasing. 

The antibody most commonly employed is Ki-67, which stains a 
proliferation-related nuclear antigen in human cells of all lineages [Gerdes 
J, Schwab U, Lemke H, Stein H. Production of a mouse monoclonal 
antibody reactive with a human nuclear antigen associated with cell 
proliferation. Int J Cancer 1983;31:13-20; Gerdes J, Lemke H, Baisch H, 
Wacker H-H, Schwab U, Stein H. Cell cycle analysis of a cell proliferation- 
associated human nuclear antigen defined by the monoclonal anKi-67. J 
Immunol 1984;133:1710-1715; and Gerdes J, Li L, Schlueter C, et al. 
Immunobiochemical and molecular biologic characterization of the cell 
proliferation-associated nuclear antigen that is defined by monoclonal 
antibody Ki-67. Am J Pathol 1991;138:867-873]. This antibody has the 
useful property of staining nuclei of cells in Gi , S, G?, and M phases of the 
cell cycle, but not the nuclei of resting (Gq phase) cells. Several studies 
have demonstrated that the proportion of tumor cell nuclei stained by Ki-67 
antibody correlates with tumor grade and other prognostic features for a 
variety of tumor types, including breast carcinoma, lymphoma, 
meningioma, glial and astrocytic brain tumors, malignant melanoma, and 
sarcoma. In non-Hodgkin's lymphoma, Ki-67 staining is associated with 
working classification grade, and increasing proliferative fraction as 
measured by Ki-67 staining is associated with a worse prognosis. In breast 
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cancer, Ki-67 staining has been correlated with nuclear grade and lymph 
node status and several studies have shown the prognostic significance of > 
Ki-67 staining in this type of cancer. The clinical usefulness of Ki-67 
antibody had been somewhat limited by the fact that the antigen is 
preserved in frozen tissue and is lost on standard fixation. However, a 
monoclonal antibody (MEB 1) has been produced which appears to stain the 
same antigen as stained by Ki-67, yet which can be used on paraffin 
sections. Thus, it should be possible to perform large retrospective studies 
on archival paraffin-embedded tissues to determine the prognostic 
significance of staining with this antibody. The recently described antibody 
Ki-Sl appears to have similar staining characteristics as Ki-67 and can be 
used on paraffin sections. The relative fraction of tumor cell nuclei positive 
for Ki-Sl staining appears to have prognostic significance in breast cancer. 

Other proliferation-associated nuclear markers may prove to have 
clinical utility. PCNA/cyclin is a 36 kDa nuclear protein present in 
proliferating cells, and is an accessory protein to DNA polymerase-delta. 
Flow cytometric studies have, demonstrated that two fractions of 
PCNA/cyclin exist in cell nuclei, the fraction that is insoluble in nonionic 
detergent being more restricted to the S phase of the cell cycle. 
Immunohistochemical staining for this protein has been demonstrated in 
frozen and paraffin-embedded tissues fixed in alcohol or formalin, thus 
permitting study of archival tissues. However, the staining in tissue 
sections varies depending on the method of tissue preparation and fixation 
as well as the clone of antibody used, and the degree of antigen detection 
appears to be sensitive to the duration of fixation, with long fixation times 
resulting in antigen loss. It was shown that detection of PCNA in paraffin 
embedded tissue can be improved using a microwave technique; excellent 
correlation with flow cytometric S-phase fraction was thereby obtained. 
Nuclei stained for PCNA/cyclin exhibit varying degrees of positivity, and 
studies have indicated that the more intensely stained nuclei correspond to 
S-phase cells. These issues are of course important to the accurate 
quantitation of antigen expression, regardless of the method used. 

Antibodies to alpha DNA polymerase have been applied to tissue 
sections of normal and malignant tissue, and may find clinical utility. PI 05 
is a nuclear antigen expressed starting at the Gq/G\ phase transition, with 
increasing expression through M phase. However, attempts to use this 
antibody in tissue sections have met with variable success, and the antibody 
may prove to be a more useful tool in flow cytometric studies than in tissue 
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section. There are changes in the level expression of a number of 
oncoproteins during the cell cycle, but use of these markers in analysing cell > . 
cycle activity in solid tumors is doubtful as overexpression is not entirely 
related. Additional markers are listed hereinunder. 

5 In most immunohistochemical studies using antibodies to 

proliferation- associated nuclear antigens, staining is measured by 
estimation or by tedious manual counting. The additional time needed to 
perform such manual analysis makes routine clinical use unlikely, given the 
time constraints of a busy pathology practice. 

10 Quantitation of staining for nuclear antigens by image analysis 

provides the means of attaining the speed, accuracy, and reproducibility of 
such measurements. The CAS 200 System mentioned hereinabove makes 
use of two video cameras to view the microscopic image separately through 
optical filters that capture either all of the ethyl green stained nuclei within 

15 the field (650 nm), or the brown reaction product of the immunoperoxidase 
reaction (500 nm) in the same field. By superimposing maps of the green 
and brown staining regions, a rapid calculation is made of the percent 
nuclear area occupied by the immunohistochemical reaction. The threshold 
for positive, staining is established using, a slide stained with control 

20 antibody. It should be noted that this measurement is not identical to 
"percent positive nuclei", which would require that individual nuclei be 
counted and correlated with the staining reaction. Such measurements are 
more easily made on cytological preparations than on tissue sections, where 
distinguishing individual nuclei, which are frequently touching or 

25 overlapping, may be difficult or impossible. Nuclear area measurements are 
performed rapidly, and the result is expressed as the cumulative average of 
all the microscopic fields measured. The intensity of the staining reaction is 
not taken into account in this measurement, although the threshold for 
positive staining can be adjusted, for example, to measure only the most 

30 intensely stained nuclei rather than all positive nuclei. This system is 
however highly limited in spectral resolution and therefore has limited 
applications. It will be appreciated that employing a system enabling 
similar spatial resolution combined with higher spectral resolution would 
revolutionize the field of QIHC. 

35 While performing QIHC the selection of fields is important, because 

tumors can be quite heterogeneous with regard to proliferative activity, and 
it is uncertain whether the average or greatest proliferative activity is most 
clinically important. In studying malignant lymphomas, for example, Ki-67 
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staining was measured using either random field selection (computer 
generated) or selective measurement of fields judged as having the greatest * - 
proliferative fraction. The measurement by random field selection proved to 
correlate well with the grade of lymphoma as well as flow cytometric S- 

5 phase fraction, whereas selecting only the most proliferative areas resulted 
in the loss of these correlations, with no differences noted among grades. 
Therefore, in malignant lymphomas, measurement of average proliferative 
activity over a large number of fields is most likely to be informative. In 
solid tumors having variable amounts of stroma, it is logical to exclude the 

10 stroma and inflammatory cells from the measurements. In a study on the 
measurement of Ki-67 expression in breast cancer, a relatively weak 
correlation with flow cytometric S-phase fraction was found, which could 
be expected given the variable dilution of tumor cells unaccounted for by 
flow cytometry. 

15 If a statistically reliable measurement of average Ki-67 staining is to 

be obtained, it is necessary to measure sufficient fields such that the 
variation of the cumulative percent staining does not vary more than 5 % of 
the mean. Some researchers argue that all such measurements should be 
expressed as the percentage values +/- the margin of error, which can be 

20 calculated on the basis of the sample size. The number of fields will vary 
depending on the heterogeneity within the tumor, but experience as well as 
statistical analysis has shown that approximately ten to twenty fields should 
be sufficient to attain a 95 % confidence interval in most cases. However, 
this average measurement may not be necessarily the most biologically 

25 relevant. 

It was shown using image analysis for measurement of PCNA/cyclin 
staining in breast cancer that there are significant differences in the .degree 
of tumor cell proliferation in the central and peripheral portions of the 
tumor. Comparing the proliferation of the in situ and infiltrating 

30 components in individual cases of breast cancer, it was shown that although 
these components usually exhibit similar degrees of Ki-67 staining, 
occasional discordances are seen which would affect the classification of 
the tumor as having a low or high proliferative fraction. Assuming that the 
infiltrating component is the more biologically relevant with regard to 

35 clinical course, it appears that careful attention to histopathology is' an 
important consideration in choosing fields for measurement. In addition, 
changes in the level and pattern of nuclear expression during progression 
through the cell cycle have been noted for Ki-67 and PCNA/cyclin. Using 
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image analysis, measurement of raining within a limited range of intensity 
as well as texture analysis may result in measurements more closely related ► 
to specific phases of the cell cycle, such as S phase. However, in any case, 
image analysis while providing excellent spatial resolution is very limited in 

5 spectral resolution, which limitation is addressed by the present invention. 

Many cases of breast cancer are responsive to hormonal therapy, and 
the presence of estrogen receptor associated with tumor cells has been 
shown to have prognostic importance as well as predictive value in 
selecting patients for anti-estrogen therapy. The determination of tumor 

10 estrogen receptor, most commonly by biochemical techniques, has become 
standard in the diagnosis and treatment of breast cancer. In general, 60 % to 
70 % of patients with estrogen receptor-positive tumors show a response to 
hormonal therapy, whereas only 5 % of receptor-negative cases respond. 

In the United States, biochemical assays for estrogen receptor and 

15 progesterone receptor are predominantly used in breast cancer, particularly 
the dextran-coated charcoal (DCC) method. However, a number of 
technical problems with the biochemical assay limit its usefulness. First, 
the widespread use of mammography has resulted in an increasing 
proportion of resected tumors too small for biochemical analysis, which 

20 requires 300 to 500 mg of tissue, and fine-needle aspiration samples 
similarly cannot be evaluated by conventional methods. In Brigham and 
Women's Hospital, approximately half of the resected breast tumors are too 
small for DCC analysis. Second, the lack of morphologic correlation can 
cause considerable error in the biochemical assay, as intermixed benign 

25 breast structures may lead to false-positive results, and excessive tumor 
dilution by normal and inflammatory cells can lead to false-negative results. 
Sampling error can be difficult to detect unless frozen sections are 
performed on the tissue prior to processing, a step not usually performed in 
most laboratories. Third, the DCC method is very labor-intensive. 

30 Therefore, there has been great interest in developing assay methods that 
circumvent these problems and improve the prognostic and therapeutic 
. usefulness of tumor hormone receptor determination. 

The commercial availability of monoclonal antibodies to estrogen 
receptor (ER) and progesterone receptor (PR) has made possible the visual 

35 detection of hormone receptors using standard immunohistochemical 
methods [Greene GL, Jensen EV. Monoclonal antibodies as probes for 
estrogen redetection and characterization. J Steroid Biochem 1982; 16:353- 
359]. Many studies have reported a good correlation between 
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immunohistochemical determination of ER/PR and the standard 
biochemical method. Most of these studies have employed semiquantitative ► - 
methods for analysing the immunohistochemical staining in tissue sections, 
methods that take into account the heterogeneity expression commonly seen 

5 in tumors. For example, the HSCORE used by McCarty and co-workers 
[McCarty KS, Szabo E, Flowers JL, et al. Use of a monoclonal anti- 
estrogen receptor antibody in the immunohistochemical evaluation of 
human tumors. Cancer Res 1986; 46:(Suppl.):4244s-4248s] is derived from 
a weighted average of the intensity of staining and the percent positive 

10 tumor nuclei, and requires subjective evaluation of staining intensity. Using 
such a method, the sensitivity and specificity of the antibody method 
compared to the biochemical assay were 88 % and 94 %, respectively (85). 
Other studies have shown similar results. 

Most studies report optimal sensitivity using cryostat sections of 

15 frozen tissue, but cytocentrifuge preparations, needle aspirates, and paraffin 
sections have all been tested with good results. Some studies have indicated 
that the immunohistochemical assay for ER is more predictive clinical 
response to hormonal therapy than the biochemical assay [Pertschuk LP, 
Kim DS, Nayer K, et al. Immunohistochemical estrogen and progesterone 

20 receptor assays in breast cancer with monoclonal antibodies: 
Histopathologic, demographic, and biochemical correlations and 
relationship to endocrine response and survival. Cancer 1990:66:1663- 
1670]. This is the strongest argument in favour of the newer method. More 
recently, some of the large cancer study groups in the United States have 

25 permitted the use of immunohistochemical determination of ER in their 
clinical trials, which will lead to more widespread acceptance of this 
method. 

A serious technical limitation in the use of immunohistochemical ER 
termination has been the difficulty of objectively analyzing and quantitating 

30 the staining reaction. Semiquantitative methods, such as the HSCORE do 
not provide the reproducibility required among laboratories, and standards 
for measuring and reporting the staining reaction have not yet been 
established. The use of image analysis does offer an opportunity to provide 
such a standard of practice for quantitation of hormone receptors in breast 

35 cancer, and the nuclear staining pattern is easily adapted for QIHC, as 
described above for Ki-67 antigen, however, since it is highly limited in 
spectral resolution it is not applicable for a multiple markers/counter stains 
study. 
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The main features of interest to be measured are the percent tumor 
cell nuclei stained for ER/PR, as well as the intensity of the staining. Both • - 
percent positivity (using total nuclear area) and intensity have been 
incorporated into a quantitative immunohistochemistry (QIHC) score, and 

5 an excellent correlation between QIHC score and biochemical 
determination of ER has been reported. However, intensity of staining is 
difficult to standardize and is subject to daily variation in the laboratory. A 
simpler approach, which was used, is to measure only the percent nuclear 
area stained, which appears to show linear correlation with biochemical ER 

io measurements less than 200 fmole/mg protein. Using a cut-off of 10 % 
positive nuclear area, one achieves 92 % sensitivity and 100 % specificity 
for ER, compared to the DCC method. Sklarew and co-workers [Sklarew 
RJ, Bodmer SC, Pertschuk LP. Comparison of microscopic imaging 
strategies for evaluating immunohistochemical (PAP) steroid receptor 

15 heterogeneity. Cytometry 1991;12:207-220] describe an imaging method 
for measuring heterogeneity of ER in tissue sections in which nuclear 
pleomorphism and variations in nuclear area caused by tissue sectioning are 
taken into account. They believe this method provides superior predictive 
value for response to endocrine therapy in breast cancer. Again, based on 

20 imaging per se, this method is limited in spectral resolution, and is therefore 
not applicable in the detection of multiple immunohistochemical marker 
stains/histological stains/DNA ploidy stains. 

It is yet uncertain whether hormone receptors measured by QIHC 
need to be converted to biochemical values, as treatment decisions are based 

25 on whether the tumor is positive or negative, not on absolute value. Indeed, 
the tumor heterogeneity as reported by QIHC may be of greater clinical 
relevance than biochemical levels, because the presence of a significant 
tumor fraction negative for hormone receptor may be predictive of failure to 
respond to therapy. Also, experience has shown that the majority of cases 

30 exhibit either no tumor cells positive for ER, or greater than 50 % of the 
cells positive, with few cases occurring near the cut-off of 10 % positivity. 
Therefore, the continuum of values seen in the biochemical assay may more 
reflect the variable dilution of tumor cells by benign tissue components than 
the true biologic range of receptor expression. Studies are needed to 

35 compare the clinical response to therapy with different image analytic 
features in order to provide a standard method for reporting QIHC of 
hormone receptors . 
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Tumor sampling is another important issue that needs to be 
addressed in breast cancer. Not infrequently, the frozen portion of the » 
tumor is not completely representative of the entire tumor. For example, the 
frozen tissue may contain only intraductal tumor, whereas a focus of 

5 invasive cancer is discovered on permanent sections. It is assumed that the 
biologic features of the invasive tumor are the most clinically relevant, and 
it cannot be assumed that the in situ and invasive tumor components exhibit 
identical features. A study was performed using image analysis to compare 
the invasive and non-invasive components of individual breast cancer cases 

10 with regard to hormone receptor expression. Good agreement between 
these components with regard to both absolute expression of ER (positive, 
negative) and level of expression of ER (percent nuclear area) was found. 
Discrepancies were observed, however, with regard to PR expression, and 
so although sampling may not be an important issue for ER, the same may 

15 not be true for PR. It was similarly observed differences between the in situ 
and invasive components of breast cancer with regard to oncogene 
expression, as reported by others. Therefore, the heterogeneity of 
expression for each marker must be established in order to provide 
guidelines for clinical measurement. 

20 Theoretically, any immunohistochemical reaction that localizes in 

the cell nucleus, cell cytoplasm, or tissue can be quantitated using image 
analysis. However, analysis of a plurality of markers simultaneously calls 
for much higher spectral resolution than is inherently available in imaging 
systems. 

25 Cell surface and cytoplasmic antigens, particularly the products of 

oncogenes, are of great clinical interest. For example, Slamon and co- 
workers [Slamon DJ, Godolphin W, Jones LA, et al. Studies of the HER- 
2/neu proto-oncogene in human breast and ovarian cancer. Science 
1989;235:177-182] have shown that both amplification and overexpression 

30 of HER-2/neu oncogene in breast and ovarian cancer correlate with a 
worsened prognosis. In their study, the intensity of immunostaining 
correlated well with other measures of gene expression, and the level of 
expression in ovarian cancer correlated with survival. These authors 
express the idea that measurement of oncogene products using 

35 immunohistochemical methods may have distinct advantages over 
biochemical methods, and may correlate best with clinical outcome. 

Various studies have demonstrated the feasibility of QIHC of 
oncogene expression. Czerniak et al. [(Czerniak B, Herz F, Wersto RP, et 
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al. Quantitation of oncogene products by computer-assisted image analysis 
and flow cytometry. J Histochem Cytochem 1990;38:463-466] have * 
demonstrated the use of image analysis to measure cellular expression of 
several oncogene products expressed in the nucleus, cytoplasm, or cell 
5 membrane, and found that the results were similar to those obtained using 
flow cytometry. Czerniak et al. later used imaging to measure Ha-ras 
expression in bladder cancer [Czerniak B, Cohen GL, Etkind P, et al. 
Concurrent mutations of coding and regulatory sequences of the Ha-ras 
gene in urinary bladder carcinomas. J Histochem Cytochem 1992;23:1199- 
10 1204], and were able to correlate increased p21 expression with specific 
gene mutations. Nuclear oncoproteins may be measured using image 
analysis in a manner similar to that described for hormone receptors and Ki- 
67 antigen, and expressed either as percent positive nuclear area or as a 
value that combines staining intensity with positivity. This approach was 
15 used by Figge et al. [Figge J, Bakst G, Weisheit K, Solis O, Ross JS. Image 
analysis quantitation of immuno-reactive retinoblastoma protein in human 
thyroid neoplasms with a streptavidin-biotin-peroxidase staining technique. 
Am J Pathol 199 1; 139:1213-1219] to measure retinoblastoma protein in 
thyroid tumors. Again, however, imaging analysis cannot provide detection 
20 of multiple markers simultaneously, although it is clear that such an ability 
would render QIHC more suitable for clinical applications. 

Because of the problems of controlling daily variations in staining 
intensity, QIHC may require the use of internal controls and calibration 
standard Bacus et al. [Bacus SS, Ruby SG, Weinberg DS, Chin D, Oriz R, 
25 Bacus JW. HER-2/neu one expression and proliferation in breast cancers. 
Am J Pathol 1990;137:103-111] used a combination of Feulgen stain (to 
measure DN content) and immunohistochemical staining for HER-2/neu in 
order to normalize the oncoprotein measurement to DNA content. Tumor 
cell lines with known levels of expression of the oncogene were used for 
30 calibration, to allow for daily variation in staining intensity. The average 
concentration oncoprotein could thus be computed on a per cell basis and 
was expressed as a percent of the level measured in a cell line known to 
exhibit high levels of overexpression. A threshold for overexpression of 
HER-2/neu was established on the basis of the low level of expression 
35 present in normal tissue. Using this approach, the authors were able to 
correlate oncogene expression with proliferative fraction growth factor 
expression and DNA content ("ploidy") in breast cancer Bacus SS, Chin D, 
Stern RK, Ortiz R, Ruby SG, Weinberg DS. HER-2/neu one expression, 
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DNA ploidy and proliferation index in. breast cancers. Anal Quant Histol 
1992;14:433.445. > 

Another example of a cellular protein that may have therapeutic 
importance is the product of the multiple drug resistance (mdr) gene, P- 

5 glycoprotein, a cell surface-associated ATPase that appears to be 
responsible for one mechanism of non-specific chemotherapy resistance. 
Grogan et al. [Grogan T, Dalton W, Rybski J, et al. Optimization of 
immunohistochemical P-glycoprotein assessment in multidrug-resistant 
plasma cell myeloma using three antibodies. Lab Invest 1991; 63:815-824] 

10 have shown a correlation between expression of P-glycoprotein and relapse 
in multiple myeloma, and have demonstrated the use of image analysis for 
measuring this protein as detected by IHC. They found that QIHC was 
more sensitive than Western blot for detecting P-glycoprotein expression. 
Other markers of therapy resistance, such as glutathione transferase and 

15 topoisom erase n, might be similarly studied. 

The measurement of tumor markers having prognostic and 
therapeutic significance is becoming an important part of diagnostic 
surgical pathology and cytology. Given the small size of many of the tumor 
samples (biopsies and needle aspirates), it will be necessary to use in situ 

20 methods, such as IHC, to detect these tumor markers, combined with 
measurement analysis if quantitation is needed. As for all laboratory tests, 
standards of practice and performance must be developed for image analysis 
to ensure the accuracy and reproducibility of these measurements. 

Like immunohistochemical stains, histological stains are routinely 

25 used in histopathology has proven useful in cancer evaluation. 

Histopathology, which forms the foundation of our knowledge about 
diseases, is a non-quantitative morphological evaluation using stained 
histological samples in which the formation of chromatin-stain complexes 
enhances the shape and structure of cells and subcellular components. The 

30 nuclear structure may, in isolation, be viewed as a dynamic reflection of the 
metabolic state of the nucleus and as a physical correlate of its total content 
of biochemical constituents. The major nuclear components are DNA, 
RNA, histone and non-histone proteins, inorganic materials and water. 
These do change during malignant transformation along with cytoplasmic 

35 and functional de-differentiation and increase in the nucleo-cytoplasmic 
ratio. Studies have proven that alterations in nuclear structure, chromatin 
pattern and nucleolar size and number are morphologic hallmarks of cancer 
diagnosis. It was shown that computerized nuclear morphometry (CNM) of 
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individual human breast cancer cells obtained by fine needle aspiration 
biopsy displayed higher reproducibility of classification than subjective » 
observations with conventional histological preparations. Quantitative 
estimation of various parameters such as two dimensional estimates of 

5 average chromatin area in the nucleus, and the number of central chromatin 
regions have been shown to correlate with prognosis and differentiation in 
breast cancer. Mean nucleolar profile area and the largest nucleolar 
microscopic dimension were found to be of prognostic value in ocular 
melanomas. In astrocytic gliomas, the relationship between optical density 

10 and nuclear profile area was shown to correlate with patient survival. 

Histopathological classification uses different staining protocols in 
order to emphasize cellular structures of tissues and cells. The most 
common staining procedure used is hematoxylin and eosin (H&E); other 
procedures are the PAS stain for the demarcation of hydrocarbon moieties, 

15 Masson's trichrome stain for extracellular staining of collagen and the 
Romanowsky-Giemsa stain in hematopathology. 

In the classical H&E stain, hematoxylin staining of the nuclei is 
followed by counter-staining of the cytoplasm and various extracellular 
materials by eosin; in this process of nuclear staining, hematoxylin is 

20 oxidized to the purple dye hematein and is provided with a net positive 
charge by this metallic salt. The H&E staining technique has remained 
mostly unchanged for over half a century except for automation of some of 
the steps. This may be due to the fact that the technique is relatively quick, 
inexpensive, suitable for most situations, comparatively easy to master and, 

25 most important, enables accurate microscopic diagnosis of most of the 
specimens. 

In order to answer specific questions, additional techniques are used 
such as the PAS and Masson's trichrome stains. In PAS staining, 
substances containing vicinal glycol groups or their amino or alkylamino 
30 derivatives are oxidized by periodic acid to form dialdehydes, which 
combine with Schiff s reagent to form an insoluble magenta compound. 
Masson's trichrome staining uses phosphotungstic or phosphomolybdic acid 
in combination with several anionic dyes such as basic fuchsin, light green 
and hematoxylin. 

35 Romanowsky-Giemsa staining is used routinely in hematological 

practice to demonstrate the various hemopoietic cells, both in the normal 
and in the diseased state. In the process of Romanowsky-Giemsa staining, 
acidic eosin binds to hemoglobin (in red cells) and eosinophylic granules (in 
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granulocytes), while basic azure binds to chromatin and ribosome-rich 
cytoplasm. Following this phase, eosin and azure B combine to form a ♦ - 
complex yielding the purple element known as the Romanowsky-Giemsa 
effect. Structures exhibiting this effect show a characteristic absorption 

5 band at approximately 550 nm, the so-called Romanowsky band. The 
Romanowsky-Giemsa technique is also used for the demonstration of 
various lymphoreticular elements (including mast cells) and micro- 
organisms in paraffin-embedded material. 

In the evaluation of infiltrating breast carcinomas, ductal and lobular 

10 carcinomas may present similar histological appearances [Azzopardi JG, 
Chepick OF, Hartmann WH, Jafarey NA, Lornbart-Bosch A, Ozello L 
(1982). The World Health Organization histological typing of breast 
tumors. 2nd ed. Am J Clin Pathol 78:806-816]. Some quantitative 
histopathological variables have been identified by morphological methods 

15 as an aid to the differentiation between ductal and lobular carcinomas 
[Ladekarl M and Sorensen FB (1993). Quantitative histopathological 
variables in in situ and invasive ductal carcinoma of the breast. AMPIS 
101(12):895-903]. The attempts to grade and to differentiate, or in other 
words to classify the tumors have been based mainly on nuclear 

20 morphology and chromatin structure [Ladekarl M and Sorensen FB (1993). 
Quantitative histopathological variables in in situ and invasive ductal 
- carcinoma of the breast AMPIS 101(12):895-903; Cornelisse CJ, de Konig 
HR, Moolenaar AJ (1984). Image and flow cytometric analysis of DNA 
content in breast cancer; relation to estrogen receptor content and lymph 

25 node involvement. Anal Quant Cytol Histol 4:9-18; Stenkvist B, Westman- 
Naeser S, Holmquist J (1978). Computerized nuclear morphology as an 
objective method for characterizing human cancer cell populations. Cancer 
Res 38:4688-4977; Dawson AE, Austin RE, Weinberg DS (1991). Nuclear 
grading of breast carcinoma by image analysis. Classification by 

30 multivariate and neural network analysis. Am J Clin Pathol 95:S29-S37]. 
Morphometric classification of other tumor types, such as but not limited to 
leukemias, lymphomas, sarcomas and other carcinomas [see, for example, 
Clarke AM, Reid WA and Jack AS (1993) Combined proliferating cell 
nuclear antigen and morphometric analysis in the diagnosis of cancerous 

35 lymphoid infiltrates. J. Clin. Pathol. 46:129-134] are also vastly 
implemented both in research medical practice. 

Nevertheless, as was recently published following an NIH workshop 
which evaluated the reliability of histopathological diagnosis by the best 
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pathologists in the field of cancer diagnostics, there is a discordance among 
expert pathologists in the diagnosis of neoplasm. Based on this workshop, * - 
it was concluded that histopathological decisionmaking is 100 % subjective, 
regardless of the origin of specimen and that this state of affairs in 

5 histopathological diagnosis is not confined to a specific tumor, but is 
' applicable to differential diagnosis in every organ. These conclusions were 
published in an editorial by A Bernard Ackerman (1996) entitled 
"Discordance among expert pathologists in diagnosis of melanocytic 
neoplasm", in Human pathology 27:1115-1116. 

10 Close to 80 % of breast carcinomas are of the ductal type [Aaltomaa 

S, Lipponen P: Prognostic factors in breast cancer (reviews). Int J Oncol 
1:153, 1992; Toikkanen S, Jensuu H (1990). Prognostic factors and long- 
term survival in breast cancer in a defined urban population. APMIS 
98:1005-1014]. The differentiation between ductal and lobular carciiiomas 

15 has proven to be useful for evaluation of patient prognosis and 
determination of treatment [Ellis IO, Galea M, Broughton N, Locker A, 
Blaney RW and Elston CW (1992). Pathological prognostic factors in breast 
cancer: II Histological type; relationship with survival in a large study with 
long term follow-up. Histopathology 20:479-489; Eskelinen M, Lipponen P, 

20 Papinaho S, Aaltomaa S, Kosma VM, Klemi P (1992). DNA flow 
cytometry, nuclear morphometry, mitotic indices and steroid receptors, as 
independent prognostic factors in female breast cancer. Int J Cancer 51:555- 
561; and Toikkanen S, Jensuu H (1990). Prognostic factors and long-term 
survival in breast cancer in a defined urban population. APMIS 98:1005- 

25 1014]. The tumors have some differences in clinical behavior and in the 
pattern of metastasis; lobular carcinoma is more multifocal and bilateral 
than ductal carcinoma [Azzopardi JG, Chepick OF, Hartmann WH, Jafarey 
NA, Lombart-Bosch A, Ozello L (1982). The World Health Organization 
histological typing of breast tumors. 2nd ed. Am J Clin Pathol 78:806-816], 

30 and patient survival expectancy, is usually better [DiConstanzo D, Rosen PP, 
Gareen I, Franklin S, Lesser M (1990). Prognosis in infiltrating lobular 
carcinoma: an analysis of "classical" and variant tumors. Am J Surg Pathol 
14:12-23; du Toit RS, Locker AP, Ellis IO, Elston CW, Nicholson RI, 
Robertson JFR (1991). An evaluation of differences in prognosis, 

35 recurrence patterns and receptor status between invasive lobular and other 
invasive carcinomas of the breast. Eur J Surg Oncol 17:251-257]. The two 
tumor types are morphologically different, cells of infiltrating lobular 
carcinoma are usually smaller than those of ductal carcinoma, less 
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pleomorphic and have fewer mitotic figures. Infiltrating ductal carcinoma 
cells have more prominent nucleoli [Azzopardi JG 3 Chepick OF, Hartmann # 
WH, Jafarey NA, Lombart-Bosch A, Ozello L (1982). The World Health 
Organization histological typing of breast tumors. 2nd ed. Am J Clin* Pathol 
5 78:806-816]. " 

Some histological types of intraductal carcinoma have been 
recognized: comedo, cribriform, micropapillary and solid. All are 
recognized and classified by specific criteria and subdivided primarily by 
architectural pattern, cellular pleomorphism, and nuclear hyperchromasia 
10 [Page DL, Anderson TG (1987). Diagnostic histopathology of the breast. 
Edinburgh, Scotland: Churchill Livingstone, 120-157; Lagios MD (1990). 
Duct carcinoma in situ pathology and treatment. Surg Clin North Am 
70:853-871; and Lennington WJ, Jensen RA, Dalton LW, Page DL: Ductal 
carcinoma in situ of the breast: Heterogeneity of individual lesions. Cancer 
15 73:118-124, 1994]. The survival expectancy for lobular carcinomas is 
usually better than that of ductal carcinomas [DiConstanzo D, Rosen PP, 
Gareen I, Franklin S, Lesser M (1990). Prognosis in infiltrating lobular 
carcinoma: an analysis of "classical" and variant tumors. Am J Surg Pathol 
14:12-23; du Toit RS, Locker AP, Ellis IO, Elston CW> Nicholson RI, 
20 Robertson JFR (1991). An evaluation of differences in prognosis, 
recurrence patterns and receptor status between invasive lobular and other 
invasive carcinomas of the breast. Eur J Surg Oncol 17:251-257]. Lobular 
carcinomas are more often bilateral and multifocal [Ladekarl M, Sorensen 
FB: Prognostic, quantitative histopathologic variables in lobular carcinoma 
25 of the breast. Cancer 72:2602, 1993] and the pattern of metastasis from the 
tumors was found to be different. Unfortunately, histological classification 
of breast carcinomas is subjected to low reproducibility and attempts to 
classify morphological subtypes of lobular carcinomas with different 
prognoses, therefore seem futile [Ladekarl M, Sorensen FB: Prognostic, 
?0 quantitative histopathologic variables in lobular carcinoma of the breast, 
Cancer 72:2602, 1993]. Both lobular and ductal types are now thought to 
arise from the terminal duct - lobular unit. 

Characterization of nuclear features by different techniques is used 
for determination of diagnosis, treatment and prognosis. Quantitative 
35 estimation of various histopathological parameters such as two dimensional 
estimates of nuclear profile area, nuclear profile densities and mitotic 
profile numbers have been shown to correlate with differentiation and 
prognosis. Alterations in nuclear structure are the morphologic hallmark of 
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cancer, diagnosis. Nuclear size, shape, chromatin pattern have all been 
reported to change in breast cancer [Pienta KJ, Coffey DS: Correlation of >. 
nuclear morphometry with progression of breast cancer. Nuclear 
Morphometry of breast cancer 2012, 1991]. However, heterogeneity in 
morphology and biology of tumors belonging to the same classification 
group has been found to be the most prominent feature of breast cancer 
[Komitowski DD and Janson CP (1990). Quantitative features of chromatin 
structure in the prognosis of breast cancer. Cancer 65:2725-2730]. 

Among 11 cytological parameters that were examined by de-las- 
Morenas et al [de-las-Morenas A, Crespo P 5 Moroz K and Donnely MM 
(1995). Cytological diagnosis of ductal versus lobular carcinoma of the 
breast. Acta Cytol 39(5):865-869] using an automated morphometric system 
on cytological specimens, chromatic pattern, nuclear size and overall cell 
size were found to be statistically different between infiltrating lobular and 
infiltrating ductal carcinoma cell nuclei. Thus, the presence of coarsely 
granular chromatin, nuclear size of more than 44 ^m^ and cell size of more 
than 82 pn 2 , were found to be related to ductal carcinoma. 

Ladekarl and Sorensen found that the main three-dimensional 
nuclear size, the main nuclear profile area and the mitotic index were all 
significantly larger in ductal than in lobular carcinomas, whereas the main 
nuclear density index was smaller in ductal carcinoma [Ladekarl M, 
Sorensen FB: Prognostic, quantitative histopathologic variables in lobular 
carcinoma of the breast. Cancer 72:2602, 1993]. Yu et al also identified 
some distinct nuclear features useful in the differentiation of infiltrating 
ductal and lobular carcinoma [Yu GH, Sneige N, Kidd LD, Johnston and 
Katz RL (1995). Image analysis derived morphometric differences in fine 
needle aspirated of ductal and lobular breast carcinoma/Anal Quant Cytol 
Histol 17(2):88-92]. 

Beside in solid tumors, the use of histological stains and 
immunohistochemical markers is also applicable for diagnosis, prognosis 
and treatment of various hematological malignancies, an example thereof is 
chronic lymphocytic leukemia (CLL). The over-accumulation of small, 
mature-appearing, B-lymphocytes in the peripheral blood is a fundamental 
hallmark of the chronic lymphocytic leukemia (CLL) diagnosis. A 
sustained cell count of more than 5xl0^/liter mature-appearing lymphocytes 
may suggest the transformation from a normal state to leukemia. The 
majority of normal lymphocytes and the dominant cellular population of 
CLL both consist of small cells with dense, clumped nuclear chromatin, 
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which makes the distinction between these lymphocytic populations 
difficult by conventional light microscopy. Some cases differ in # 
morphological feature from the typical mature, small cell B-CLL: (i) a 
mixture of small lymphocytes and prolymphocytes (>10 % and <55 %) 

5 designated as CLL/PL, or (ii) CLL mixed with large lymphocytes. 

The French-American-British group (FAB) has proposed criteria 
based on cytochemical and immunological methods in order to establish a 
clear diagnosis. Immunophenotypic analysis reveals large amounts of 
surface immunoglobulin (slg) in normal B cells which is only weakly 

io expressed, or undetectable, on B-CLL cells. The CLL cell expresses the 
pan-B antigens CD 19 and CD20 and the activation antigens CD5 and 
CD23, however it does not express the terminal B-cell differentiation 
antigens exhibited by plasma cells. B-CLL cells express either kappa or 
lambda-light chains and the monoclonality is essential to establish the 

15 diagnosis. Receptors for mouse red blood cell rosettes (MRBC-R) are 
detectable on both B-CLL cells and normal B cells, however, the two 
populations express different patterns of complement receptor, which may . 
serve to distinguish therebetween. 

U.S. Pat. No. 5,086,476, to Bacus et al., which is incorporated by 

20 reference as if fully set forth herein, teaches an image processing method 
and apparatus for determining a proliferation index of a cell sample by 
staining the cells with a chromogen for a proliferation substance and a 
counterstain for the cell nuclei. The chromogen is activated by an antibody- 
enzyme conjugate which binds to the proliferation substance to produce a 

25 stained cell sample. The stained cell sample is examined with an optical 
microscope, forming a portion of the apparatus, which produces a magnified 
cell sample image. The apparatus optically filters the cell sample image and 
produces a pair of optically enhanced proliferation substance and cell nuclei 
images. The enhanced images are electronically analyzed to determine the 

30 amounts of cell nuclei and proliferation substance appearing in the images, 
respectively. The amounts are then compared to yield a proliferation index 
for the portion of the cell sample appearing in the cell sample image. 

U.S. Pat. No. 5,109,429 to Bacus et al., which is incorporated by 
reference as if fully set forth herein, teaches a kit for the quantitation of 

35 components in cell nuclei, wherein the kit includes a stain and microscopic 
slides. Each slide has reference cell objects and a specimen cell area for 
receipt of specimen cells which are stained simultaneously with the 
reference cell objects. 
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U.S. Pat. No. 5,202,931 to Bacus et al., which is incorporated by 
reference as if fully set forth herein, teaches an image analysis system for » 
the quantitation of nuclear proteins in cell populations. Particularly, the 
hormonal receptor content of fine needle aspirates of human breast 

5 carcinomas are evaluated. Estrogen or progesterone receptors are amplified 
and visualized in the specimen by a staining technique of the 
immunoperoxidase type. Monoclonal antibodies specific against the 
receptor are attached to the receptor sites and are then amplified by a 
bridging antibody which attaches to the monoclonal antibody and a 

10 peroxidase-antiperoxidase complex. A chromogen, diaminobenzidine is 
combined with the complex and treated with hydrogen peroxide to react 
with the peroxidase forming an insoluble brown precipitate which marks the 
receptor sites for optical identification. The specimen is then counterstained 
with another chromogen, methyl green which is specific to the nucleus of 

15 each cell. Two monochromatic filterings optically separate the areas stained 
by the receptor site optical enhancer and the nuclear area optical enhancer. 
Measurements of the optical density values of the stained receptor areas 
yield an intensity value directly related to the quantity of hormonal receptor 
in the specimen. A comparison of the nuclear area containing hormonal 

20 receptor with the total nuclear area yields a percentage value which 
indicates the distribution of cells throughout of the specimen which contain 
receptor. These two values for intensity and distribution are then combined 
to yield a predictive score for an assay. The measured score when compared 
to an empirically derived reference score is predictive of the prognosis of 

25 endocrine therapy. 

U.S. Pat. No. 5,281,517 to Bacus et al., which is incorporated by 
reference as if fully set forth herein, teaches a method and apparatus for 
selecting and analyzing a subpopulation of cells or cell objects for a certain 
parameter such as DNA using image analysis means. The cells are first 

30 stained with an alkaline phosphatase technique including a monoclonal 
antibody specific to a protein in at least one of the cell's cytoplasm or on a 
cell membrane, thereby marking any cells including the protein as to type. 
A second staining of the DNA in the nucleus is accomplished by a Feulgen 
technique that destroys the cell cytoplasm. After the staining and marking, 

35 the cells may then be gated using the image analysis means on the visual 
parameter such as colored DNA or colored antigen into a subpopulation that 
is to be measured. The selected cells may then be examined by digital image 
processing and measured for a parameter such as a true actual measurement 
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of DNA in picograms. A quantitation of the measured parameter may be 
generated and provided. » 

U.S. Pat. No. 5,428,690 to Bacus et al., which is incorporated by 
reference as if fully set forth herein, teaches an apparatus and method for 

5 automated assay of biological specimens positioned on microscope slides. 
The apparatus comprises an interactive optical subsystem for viewing the 
biological specimen on the slide and for producing an interactive video 
signal corresponding to the viewed image. An automated optical subsystem 
includes a single high power microscope objective for scanning a rack of 

10 slides, portions of which having been previously identified for assay in the 
interactive optical means. The system also includes a processor for 
processing the interactive and automatic video signals for the two optical 
subsystems. The processor receives the automatic video signal and performs 
biological assay functions upon it. A method and apparatus are also 

15 disclosed for marking points for later analysis on the microscope slides and 
for associating an analysis function with each marked point. 

U.S. Pat. No. 5,252,487 to Bacus et al., which is incorporated by 
reference as if fully set forth herein, teaches an apparatus and method for 
determining an amount of oncogene protein product copies in a cell 

20 includes an optical conversion module for measuring an amount of optically 
enhanced DNA in a cell sample. A subsystem for measuring an amount of 
an optically enhanced oncogene protein product protein product is coupled 
to the DNA measuring means. A subsystem for comparing the measured 
DNA amount and measured oncogene protein product amount produces an 

25 oncogene protein product copy measurement which is fed to an output 
device for producing an output indicative of the amounts of the oncogene 
protein product in the cells of the cell sample. 

U.S. Pat. No. 5,288,477 to Bacus et al., which is incorporated by 
reference as if fully set forth herein, teaches a method for prognosticating 

30 the effectiveness of a chemotherapy using monoclonal antibodies and ligand 
molecules. The putative anti-cancer agent has binding specificity for a 
oncogenic receptor molecule on the membrane of a cancer cell, such as 
HER-2/neu. When the putative agent binds to the oncogenic receptor, the 
receptor translocates from the membrane to the cytoplasm or perinucleus of 

35 the cancer cell, accompanied by a transient increase in the total cellular 
content of the receptor, and results in terminal cell differentiation. The 
efficacy of the agent in vivo can be determined in vitro by treatment of 
biopsied cancer cells with the agent and subsequent examination of the cells 
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for evidence of terminal cell differentiation. Such evidence includes 
morphological change, reduction in cell growth, or production of chemicals * - 
associated with the mature phenotype. Additionally, treated cells may be 
examined with immunohistochemicals specific for the oncogenic receptor, 
5 to determine translocation of the receptor from the membrane to the 
cytoplasm or perinucleus. Quantification of receptor levels in treated cells 
by measuring optical densities after staining can be used to determine 
translocation, as well as a transient increase in total cellular content of the 
receptor. 

10 U.S. Pat. No. 5,134,662 to Bacus et al., which is incorporated by 

reference as if fully set forth herein, teaches a method and apparatus for use 
in performing automated classification of cells and other microscopic 
specimens. The apparatus provides a compact, adjustable assembly that is 
operable to provide: an operator-apparatus interactive classification system 

15 for the cell analysis; alternative techniques for different cells, cytoplasms 
and cell populations; and enhanced image or color separation and analysis. 

U.S. Pat. No. 5,473,706 to Bacus et al., which is incorporated by 
reference as if fully set forth herein, teaches an apparatus and method for 
automated assay of biological specimens positioned on microscope slides. 

20 The apparatus comprises an interactive optical subsystem for viewing the 
biological specimen on the slide and for producing an interactive video 
signal corresponding to the. viewed image. An automated optical subsystem 
includes a single high power microscope objective for scanning a rack of 
slides, portions of which having been previously identified for assay in the 

25 interactive optical subsystem. The system also includes a processor for 
processing the interactive and automatic video signals from the two optical 
subsystems. The processor receives the automatic video signal and performs 
biological assay functions upon it. 

U.S. Pat. No. 5,526,258 to Bacus et al., which is incorporated by 
1 30 reference as if fully set forth herein, teaches an apparatus and method for 
analyzing the cell objects of a cell sample for the diagnosis and treatment of 
actual or suspected cancer is disclosed. An image of the cell sample is first 
digitized and morphological attributes, including area and DNA mass of the 
cell objects are automatically measured from the digitized image. The 

35 measured attributes are compared to ranges of attribute values which are 
preestablished to select particular cell objects having value in cancer 
analysis. After the selection of cell objects, the image is displayed to an 
operator and indicia of selection is displayed with each selected cell object. 
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The operator then reviews the automatically selected cell objects, with the 
benefit of the measured cell object attribute values and accepts or changes * 
the automatic selection of cell objects. In a preferred embodiment, each 
selected cell object is assigned to one of six classes and the indicia of 

5 selection consists of indicia of the class into which the associated cell object 
has been placed. The measured DNA mass of identified cell object 
fragments in tissue section samples may also be increased to represent the 
DNA mass of the whole cell object from which the fragment was sectioned. 
U.S. Pat. No. 5,546,323 to Bacus et al., which is incorporated by 

10 reference as if fully set forth herein, teaches an apparatus and method for 
measuring the thickness of a tissue section with an. automated image 
analysis system, preferably using polyploid nuclear DNA content, for 
subsequent use in analyzing cell objects of a specimen cell sample for the 
diagnosis and treatment of actual or suspected cancer or monitoring any 

15 variation in the nominal thickness in a microtome setting. An image of a 
measurement material, such as a rat liver tissue section, having known cell 
object attributes is first digitized and the morphological attributes, including 
area and DNA mass of the cell objects, are automatically measured from the 
digitized image. The measured attributes are compared to ranges of attribute 

20 values which are preestablished to select particular cell objects. After the 
selection of the cell objects, the operator may review the automatically 
selected cell 'objects and accept or change the measured cell object attribute 
values. In a preferred embodiment, each selected cell object is assigned to 
one of three classes corresponding to diploid, tetraploid and octoploid cell 

25 morphology and the measured DNA mass of the identified cell object 
fragments in the rat liver tissue section sample may be corrected. Next, the 
selected cell objects of the measurement material, e.g., DNA Mass, are then 
graphically displayed in a histogram and the thickness of the rat liver tissue 
section can be measured based upon the distribution. 

30 U.S. Pat. No. 5,018,209 to Bacus et al., which is incorporated by 

reference as if fully set forth herein, teaches a method and apparatus for 
selecting and analyzing a subpopulation of cells or cell objects for a certain 
parameter such as DNA, estrogen, and then measuring the selected cells. 
The observer in real time views a field of cells and then gates for selection 

35 based on the morphological criteria those cells that have the visual 
parameter such as colored DNA or colored antigen into a subpopulation that 
is to be measured. The selected cells are examined by digital image 
processing and are measured for a parameter such as a true actual 
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measurement of DNA in picograms. A quantitation of the measured 
parameter is generated and provided. • 

U.S. Pat. No. 4,998,284 to Bacus et al., which is incorporated by 
reference as if folly set forth herein, teaches a method and apparatus for use 
5 in performing automated classification of cells and other microscopic 
specimens. The apparatus provides a compact, adjustable assembly that is 
operable to provide: an operator-apparatus interactive classification system 
for the cell analysis; alternative techniques for different cells, cytoplasms 
and cell populations; and enhanced image or color separation and analysis. 
10 U.S. Pat. No. 4,741,043 to Bacus et al., which is incorporated by 

reference as if fully set forth herein, teaches a user interactive system for 
dynamically- testing and evaluating various cells, antigens, or other 
materials taken from the human body. More specifically, the DNA in 
specimen cells is analyzed and quantified by image analysis using pattern 
15 recognition techniques. The user is provided with a unique slide or support 
on which there are specimen and reference materials or objects which are 
simultaneously stained or otherwise image enhanced at the time of analysis. 

The following conclusions can be drawn from the above discussion. 

First, in sifu analysis of neoplasm may be useful for clinical 
20 applications, to enable better diagnosis, prognosis and treatment strategy. 

Second, histological stains, unique immunohistochemical markers 
and DNA ploidy stains, both conventional and immunostains, are all useful 
for that purpose. 

Third, so far it was not attempted or suggested to use a plurality of 
25 specific immunohistochemical stains combined with several histological 
stains and DNA ploidy stains to label cells and thereafter extract 
pathological data therefrom because, while systems providing the adequate 
spatial resolution (imaging systems) are widely used, systems providing the 
adequate spatial resolution combined with an adequate spectral resolution 
30 are much less abundant. 

Such systems, however, were developed and recently were employed 
for various applications as further detailed hereinunder. 

A spectrometer is an apparatus designed to accept light, to separate 
(disperse) it into its component wavelengths, and measure the lights 
35 spectrum, that is the intensity of the light as a function of its wavelength. 
An imaging spectrometer is a spectrometer which collects incident light 
from a scene and measures the spectra of each pixel (i.e., picture element) 
thereof. 
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Spectroscopy is a well known analytical tool which has been used for 
decades in science and industry to characterize materials and processes * - 
based on the spectral signatures of chemical constituents therein. The 
physical basis of spectroscopy is the interaction of light with matter. 
5 Traditionally, spectroscopy is the measurement of the light intensity 
emitted, scattered or reflected from or transmitted through a sample, as a 
function of wavelength, at high spectral resolution, but without any spatial 
information. 

Spectral imaging, on the other hand, is a combination of high 
io resolution spectroscopy and high resolution imaging (i.e., spatial 
information). Most of the works so far described concern either obtaining 
high spatial resolution information from a biological sample, yet providing 
only limited spectral information, for example, when high spatial resolution 
imaging is performed with one or several discrete band-pass filters [See, 
15 Andersson-Engels et al (1990) Proceedings of SPIE - Bioimaging and 
Two-Dimensional Spectroscopy, 1205, pp. 179-189], or alternatively, 
obtaining high spectral resolution (e.g., a full spectrum), yet limited in 
spatial resolution to a small number of points of the sample or averaged 
over the whole sample [See for example, U.S. Pat. No. 4,930,516, to Alfano 
20 etal.]. 

Conceptually, a spectral imaging system consists of (i) a 
measurement system, and (ii) an analysis software. The measurement 
system includes all of the optics, electronics and the manner in which the 
sample is illuminated (e.g., light source selection), the mode of 

25 measurement (e.g., fluorescence or transmission), as well as the calibration 
best suited for extracting the desired results from the measurement. The 
analysis software includes all of the software and mathematical algorithms 
necessary to analyze and display important results in a meaningful way. 

Spectral imaging has been used for decades in the area of remote 

30 sensing to provide important insights in the study of Earth and other planets 
by identifying characteristic spectral absorption features originating 
therefrom. However, the high cost, size and configuration of remote 
sensing spectral imaging systems (e.g., Landsat, AVIRIS) has limited their 
use to air and satellite-born applications [See, Maymon and Neeck (1988) 

35 Proceedings of SPIE - Recent Advances in Sensors, Radiometry and Data 
Processing for Remote Sensing, 924, pp. 10-22; Dozier (1988) Proceedings 
of SPIE - Recent Advances in Sensors, Radiometry and Data Processing for 
Remote Sensing, 924, pp. 23-30], 
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There are three basic types of spectral dispersion methods that might 
be considered for a spectral bio-imaging system: (i) spectral grating or fr 
prism, (ii) spectral jfilters and (iii) interferometric spectroscopy. As will be 
described below, the latter is best suited to implement the method of the 
present invention, yet as will be appreciated by one ordinarily skilled in the 
art, grating, prism and filters based spectral bio-imaging systems may also 
be found useful in some applications. 

In a grating or prism (i.e., monochromator) based systems, also 
known as slit-type imaging spectrometers, such as for example the DILOR 
system: [see, Valisa et al (Sep. 1995) presentation at the SPEB Conference 
European Medical Optics Week, BiOS Europe 1995, Barcelona, Spain], 
only one axis of a CCD (charge coupled device) array detector (the spatial 
axis) provides real imagery data, while a second (spectral) axis is used for 
sampling the intensity of the light which is dispersed by the grating or prism 
as function of wavelength. The system also has a slit in a first focal plane, 
limiting the field of view at any given time to a line of pixels. Therefore, a 
full image can only be obtained after scanning the grating (or prism) or the 
incoming beam in a direction parallel to the spectral axis of the CCD in a 
method known in the literature as line scanning. The inability to visualize 
the two-dimensional image before the whole .measurement is completed, 
makes it impossible to choose, prior to making the measurement, a desired 
region of interest from within the field of view and/or to optimize the 
system focus, exposure time, etc. Grating and prism based spectral imagers 
are in use for remote sensing applications, because an airplane (or satellite) 
flying over the surface of the Earth provides the system with a natural line 
scanning mechanism. 

It should be further noted that slit-type imaging spectrometers have a 
major disadvantage since most of the pixels of one frame are not measured 
at any given time, even though the fore-optics of the instrument actually 
collects incident light from all of them simultaneously. The result is that 
either a relatively large measurement time is required to obtain the 
necessary information with a given signal-to-noise ratio, or the 
signal-to-noise ratio (sensitivity) is substantially reduced for a given 
measurement time. Furthermore, slit-type spectral imagers require line 
scanning to collect the necessary information for the whole scene, which 
may introduce inaccuracies to the results thus obtained. 

Filter based spectral dispersion methods can be further categorized 
into discrete filters and tunable filters. In these types of imaging 
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spectrometers the spectral image is built by filtering the radiation for all the 
pixels of the scene simultaneously at a different wavelength at a time by » - 
inserting in succession narrow band filters in the optical path, or by 
electronically scanning the bands using acousto-optic tunable filters 
5 (AOTF) or liquid-crystal tunable filter (LCTF), see below. Similarly to the 
slit type imaging spectrometers equipped with a grating or prism as 
described above, while using filter based spectral dispersion methods, most 
of the radiation is rejected at any given time. In fact, the measurement of 
the whole image at a specific wavelength is possible because all the photons 
10 outside the instantaneous wavelength being measured are rejected and do 
not reach the CCD. 

Tunable filters, such as AOTFs and LCTFs have no moving parts 
and can be tuned to any particular wavelength in the spectral range of the 
device in which they are implemented. One advantage of using tunable 
15 filters as a dispersion method for spectral imaging is their random, 
wavelength access; i.e., the ability to measure the intensity of an image at a 
number of wavelengths, in any desired sequence without the use of filter 
wheels. However, AOTFs and LCTFs have the disadvantages of (i) limited 
spectral range, (typically, A. max = 2X m j n ) while all other radiation that falls 
20 outside of this spectral range must be blocked, (ii) temperature sensitivity, 
(iii) poor transmission, (iv) polarization sensitivity, and (v) in the case of 
AOTFs an effect of shifting the image during wavelength scanning, 
demanding careful and complicated registration procedures thereafter. 

All these types of filter and tunable filter based systems have not 
25 been used successfully and extensively over the years in spectral imaging 
for any application, because of their limitations in spectral resolution, low 
sensitivity, and lack of easy-to-use and sophisticated software algorithms 
for interpretation and display of the data. 

A method and apparatus for spectral analysis of images which have 
30 advantages in the above respects was disclosed in U.S. Pat. application No. 
08/392,019 to Cabib et ah, filed Feb. 21st, 1995, now U.S. Pat. No. 
5,539,517, issued Jul. 23, 1996, which is incorporated by reference as if 
fully set forth herein, with the objective to provide a method and apparatus 
for spectral analysis of images which better utilizes all the information 
35 available from the collected incident light of the image to substantially 
decrease the required frame time and/or to substantially increase the 
signal-to-noise ratio, as compared to the conventional slit- or filter type 
imaging spectrometer, and does not involve line scanning. According to 
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this invention, there is provided a method of analyzing an optical image of a 
scene to determine the spectral intensity of each pixel thereof by collecting » 
incident light from the scene; passing the light through an interferometer 
which outputs modulated light corresponding to a predetermined set of 
5 linear combinations of the spectral intensity of the light emitted from each 
pixel; focusing the light outputted from the interferometer on a detector 
array, scanning the optical path difference (OPD) generated in the 
interferometer for all pixels independently and simultaneously and 
processing the outputs of the detector array (the interferograms of all pixels 
io separately) to determine the spectral intensity of each pixel thereof. This 
method may be practiced by utilizing various types of interferometers 
wherein the OPD is varied to build the interferograms by moving the entire 
interferometer, an element within the interferometer, or the angle of 
incidence of the incoming radiation. In all of these cases, when the scanner 
15 completes one scan of the interferometer, the interferograms for all pixels of 
the scene are completed. 

Apparatuses in accordance with the above features differ from the 
conventional slit- and filter type imaging spectrometers by utilizing an 
interferometer as described above, therefore not limiting the collected 
20 energy with an aperture or slit or limiting the incoming wavelength with 
narrow band interference or tunable filters, thereby substantially increasing 
the total throughput of the system. Thus, interferometer based apparatuses 
better utilize all the information available from the incident light of the 
scene to be analyzed, thereby substantially decreasing the measurement 
25 time and/or substantially increasing the signal-to-noise ratio (i.e., 
sensitivity). The sensitivity advantage that interferometric spectroscopy has 
over the filter and grating or prism methods is known in the art as the 
multiplex or Fellgett advantage [see, Chamberlain (1979) The principles of 
interferometric spectroscopy, John Wiley and Sons, pp. 16-18 and p. 263]. 
30 Consider, for example, the "whisk broom" design described in John 

B. Wellmari (1987) Imaging Spectrometers for Terrestrial and Planetary 
Remote Sensing, SPIE Proceedings, Vol. 750, p. 140. Let n be the number 
of detectors in the linear array, m x m the number of pixels in a frame and T 
the frame time. The total time spent on each pixel in one frame summed 
35 over all the detectors of the array is nT/m 2 . By using the same size array 
and the same frame rate in a method according to the invention described in 
U.S. Pat. No. 5,539,517, the total time spent summed over all the detectors 
on a particular pixel is the same, nT/m 2 . However, whereas in the 
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conventional grating or prism method the energy seen by every detector at 
any time is of the order of \ln of the total, because the wavelength * - 
resolution is l/n of the range, in a method according to the invention 
described in U.S. Pat. application No. 08/392,019 the energy is of the order 

5 of unity, because the modulating function is an oscillating function (e.g., 
sinusoidal (Michelson) or similar periodic function such as low finesse Airy 
function with Fabry-Perot) whose average over a large OPD range is 50%. 
Based on the standard treatment of the Fellgett advantage (or multiplex 
advantage) described in interferometry textbooks [for example, see, 

10 Chamberlain (1979) The principles of interferometric spectroscopy, John 
Wiley and Sons, pp. 16-18 and p. 263], it is possible to show that devices 
according to this invention have measurement signal-to-noise ratios which 
are improved by a factor of « 0 5 in the cases of noise limitations in which 
the noise level is independent of signal (system or background noise limited 

15 situations) and by the square root of the ratio of the signal at a particular 
wavelength to the average signal in the spectral range, at wavelengths of a 
narrow peak in the cases the limitation is due to signal photon noise. Thus, 
according to the invention described in U.S. Pat. No. 5,539,517, all the 
required OPDs are scanned simultaneously for all the pixels of the scene in 

20 order to obtain all the information required to reconstruct the spectrum, so 
that the spectral information is collected simultaneously with the imaging 
information. This invention can be used with many different optical 
configurations, such as a telescope for remote sensing, a microscope for 
laboratory analysis, fundus cameras for retinal imaging, fiber optics and 

25 endoscopes for industrial monitoring and medical imaging, diagnosis, 
therapy and others. 

In a continuation application (U.S. Pat. application 08/571,047 to 
Cabib et aL, filed December 12, 1995, which is incorporated by reference as 
if fully set forth herein) the objective was to provide spectral imaging 

30 methods for biological research, medical diagnostics and therapy, which 
methods can be used to detect spatial organization (i.e., distribution) and to 
quantify cellular and tissue natural constituents, structures, organelles and 
administered components such as tagging probes (e.g., fluorescent probes) 
and drugs using light transmission, reflection, scattering and fluorescence 

35 emission strategies, with high spatial and spectral resolutions. In U.S. Pat. 
application 08/571,047, the use of the spectral imaging apparatus described 
in U.S. Pat. No. 5,539,517 for interphase fluorescent in situ hybridization of 
as much as six loci specific probes (each loci located on a different 
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chromosome) was demonstrated, as well as additional biological and 
medical applications. * 

Spectral bio-imaging systems are potentially useful in all 
applications in which subtle spectral differences exist between chemical 

5 constituents whose spatial distribution and organization within an image are 
of interest. The measurement can be carried out using virtually any optical 
system attached to the system described in U.S. Pat. No. 5,539,517, for 
example, an upright or inverted microscope, a fluorescence microscope, a 
macro lens, an endoscope and a fundus camera. Furthermore, any standard 

10 experimental method can be used, including light transmission (bright field 
and dark field), auto-fluorescence and fluorescence of administered probes, 
etc. 

Fluorescence measurements can be made with any standard filter 
cube (consisting of a barrier filter, excitation filter and a dichroic mirror), or 

15 any customized filter cube for special applications, provided that the 
emission spectra fall within the spectral range of the system sensitivity. 
Spectral bio-imaging can also be used in conjunction with any standard 
spatial filtering method such as dark field and phase contrast, and even with 
polarized light microscopy. The effects on spectral information when using 

20 such methods must, of course, be understood to correctly interpret the 
measured spectral images. 

U.S. Pat. application No. 08/824,234, filed March 25, 1997, which is 
incorporated by reference as if fully set forth herein teaches methods for 
automatic and/or semiautomatic spectrally resolved morphometric 

25 classification (e.g., detection, grading) of neoplasm, which are designed to 
provide objective, as opposed to subjective cell (e.g., cancer cell) 
classification. According to the method disclosed therein (a) a sample 
including at least a portion of at least one ceil is prepared to be spectrally 
imaged; (b) the sample is viewed through an optical device optically 

30 connected to an imaging spectrometer for obtaining a spectrum of each 
pixel of the sample; (c) each of the pixels is classified into classification 
groups according to the pixels spectra; and (d) by analyzing the 
classification groups of pixels, the cells of the sample are classified into cell 
classes. This method was exemplified with respect to counterstained breast 

35 carcinomas. 

The combination of spectral imaging, in situ counterstaining and in 
situ immunostaining is suggested and attempted herein for the first time. 
Such a combination enables simultaneous detection of a plurality of 
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immunohistochemical stains, histological stains and DNA ploidy stains 
which was not possible using the prior art imaging methods. Such a » 
combination is therefore expected to revolutionize the field of cellular 
pathology by combining data extracted simultaneously from various 
5 histological stains, DNA ploidy stains and specific immunohistochemical 
stains. 

There is thus a widely recognized need for, and it would be highly 
advantageous to have, a method of simultaneous in situ analysis of a 
plurality of immunohistochemical stains, histological stains and DNA 
10 ploidy stains, using spectral imaging techniques, of high spatial and spectral 
resolutions. 

SI JM MAR Y O F THE TNVBNTION 

According to the present invention there is provided a method of in 

15 situ analysis of a biological sample comprising the steps of (a) staining the 
biological sample with N stains of which a first stain is selected from the 
group consisting of a first immunohistochemical stain, a first histological 
stain and a first DNA ploidy stain, and a second stain is selected from the 
group consisting of a second immunohistochemical stain, a second 

20 histological stain and a second DNA ploidy stain, with provisions that N is 
an integer greater than three and further that (i) if the first stain is the first 
immunohistochemical stain then the second stain is either the second 
histological stain or the second DNA ploidy stain; (ii) if the first stain is the 
first histological stain then the second stain is either the second 

25 immunohistochemical stain or the second DNA ploidy stain; whereas (iii) if 
the first stain is the first DNA ploidy stain then the second stain is either the 
second immunohistochemical stain or the second histological stain; and (b) 
using a spectral data collection device for collecting spectral data from the 
biological sample, the spectral data collection device and the N stains are 

30 selected such that a spectral component associated with each of the N stains 
is collectable. 

According to further features in preferred embodiments .of the 
invention described below, there is provided a method of in situ analysis of 
a biological sample comprising the steps of (a) staining the biological 
35 sample with a plurality of stains of which a first stain is selected from the 
group consisting of a first immunohistochemical stain, a first histological 
stain and a first DNA ploidy stain, and a second stain is selected from the 
group consisting of a second immunohistochemical stain, a second 
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histological stain and a second DNA ploidy stain, with a provision that (i) if 
the first stain is the first immunohistochemical stain then the second stain is . * ■ - 
either the second histological stain or the second DNA ploidy stain; (ii) if 
the first stain is the first histological stain then the second stain is either the 

5 second immunohistochemical stain or the second DNA ploidy stain; 
whereas (iii) if the first stain is the first DNA ploidy stain then the second 
stain is either the second immunohistochemical stain or the second 
histological stain; and (b) using a spectral data collection device for 
collecting spectral data from the biological sample, the spectral data 

10 collection device and the plurality of stains are selected such that a spectral 
component associated with each of the plurality of stains is collectable. 

According to still further features in the described preferred 
embodiments there is provided a method of in situ analysis of a biological 
sample comprising the steps of (a) staining the biological sample with at 

15 least four different immunohistochemical stains; and (b) using a spectral 
data collection device for collecting spectral data from the biological 
sample, the spectral data collection device and the at least four 
immunohistochemical stains are selected such that a spectral component 
associated with each of the at least four immunohistochemical stains is 

20 collectable. 

According to still further features in the described preferred 
embodiments there is provided a method of in situ analysis of a biological 
sample comprising the steps of (a) staining the biological sample with at 
least three stains of which at least one stain is an immunohistochemical 

25 stain and at least one additional stain is a histological stain or a DNA ploidy 
stain; and (b) using a spectral data collection device for collecting spectral 
data from the biological sample, the spectral data collection device and the 
at least three stains are selected such that a spectral component associated 
with each of the at least three stains is collectable. 

30 According to still further features in the described preferred 

embodiments there is provided a method of in situ analysis of a biological 
sample comprising the steps of (a) staining the biological sample with at 
least three stains of which a first stain is an immunohistochemical stain, a 
second stain is a histological stain and a third stain is a DNA ploidy stain; 

35 and (b) using a spectral data collection device for collecting spectral data 
from the biological sample, the spectral data collection device and the at 
least three stains are selected such that a spectral component specifically 
associated with each of the at least three stains is collectable. 
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According to still further features in the described preferred 
embodiments there is provided an immunohistochemical composition * - 
comprising at least four different immunohistochemical stains, each being 
for staining a respective cytological marker and each being individually 
5 detectable in a presence of all others using a spectral data collection device. 

According to still further features in the described preferred 
embodiments the first and second immunohistochemical stains each 
independently includes a primary antibody and a signal amplification 
mechanism. 

10 According to still further features in the described preferred 

embodiments the signal amplification mechanism is selected from the 
group consisting of a secondary antibody capable of binding a constant 
region of the primary antibody, avidin or strepavidin capable of binding 
biotin conjugated to the primary antibody and biotin capable of binding 

15 avidin or strepavidin conjugated to the primary antibody. 

According to still further features in the described preferred 
embodiments the secondary antibody, avidin, strepavidin and biotin are 
each independently labeled with a detectable moiety. 

According to still further features in the described preferred 

20 embodiments the detectable moiety is a fluorescent dye. 

According to still further features in the described preferred 
embodiments the fluorescent dye is selected from the group consisting of 
Fluorescein, Rhodamine, Texas Red, Cy2, Cy3, Cy5, CyO, Cy0.5, Cyl, 
Cyl.5, Cy3.5, Cy7, VECTOR Red, ELF™ (Enzyme-Labeled Fluorescence), 

25 FluorX, Calcein, Calcein-AM, CRYPTOFLUOR™'S, Orange (42 kDa), 
Tangerine (35 kDa), Gold (31 kDa), Red (42 kDa), Crimson (40 kDa), 
BHMP, BHDMAP, Br-Oregon, Lucifer Yellow, Alexa dye family, N-[6-(7- 
nitrobenz-2-oxa-l, 3-diazol-4-yl)amino]caproyl] (NBD), BODIPY™, boron 
dipyrromethene difluoride, Oregon Green, MITOTRACKER™ Red, 

30 DiOC7(3), DilCig, Phycoerythrin, Phycobiliproteins BPE (240 kDa) RPE 
(240 kDa) CPC (264 kDa) APC (104 kDa), Spectrum Blue, Spectrum Aqua, 
Spectrum Green, Spectrum Gold, Spectrum Orange, Spectrum Red, NADH, . 
NADPH, FAD, Infra-Red (IR) Dyes, Cyclic GDP-Ribose (cGDPR), 
Calcofluor White, Tyrosine and Tryptophan. 

35 According to still further features in the described preferred 

embodiments the detectable moiety is a non- fluorescent dye. 

According to still further features in the described preferred 
embodiments the non-fluorescent dye is selected from the group consisting 
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of alkaline phosphatase, horseradish peroxidase, glucose oxidase and beta- 
galactosidase substrates. 

According to still further features in the described preferred 
embodiments the detectable moiety is an enzyme catalyzing a colorimetric 
reaction of a substrate having a substantially non-soluble color reaction 
product. 

According to still further features in the described preferred 
embodiments the enzyme is selected from the group consisting of alkaline 
phosphatase, horseradish peroxidase, (J-galactosidase, and glucose oxidase. 

According to still further features in the described preferred 
embodiments the substrate is selected from the group consisting of alkaline 
phosphatase, horseradish peroxidase, p-galactosidase, and glucose oxidase 
substrates. 

According to still further features in the described preferred 
embodiments the detectable moiety is an enzyme catalyzing a 
luminescence reaction of a substrate having a substantially non-soluble 
reaction product capable of luminescencing or of directing a second reaction 
of a second substrate having a luminescencing product. 

According to still further features in the described preferred 
embodiments the enzyme is selected from the group consisting of 
luciferase and aequorin. 

According to still further features in the described preferred 
embodiments the first and second substrates are each independently selected 
from the group consisting of luciferine, ATP, Ca 4 ** 1 " and coelenterazine. 

According to still further features in the described preferred 
embodiments the first and second histological stains are each independently 
selected from the group consisting of 4\6-chamidino-2-phenylindole, Eosin, 
Fluorescein isothiocyanate, Hoechst 33258, Hoechst . 33342, Propidium 
Iodide, Quinacrine, Fluorescein-phalloidin, Resorufin, hematoxylin, Orange 
G, Light Green SF, Romanowsky-Giemsa, May-Grunwald, Blue 
counterstain, ethyl green, Feulgen-naphthol yellow S, Giemsa, Methylene 
Blue, Methyl Green, pyronin, Naphthol-yellow, Neutral Red, Papanicolaou 
stain, Red Counterstain C and Sirius Red. 

According to still further features in the described preferred 
embodiments the first and second DNA ploidy stains are each 
independently selected from the group consisting of Chromomycin A 3, 
DAPI, Acriflavine-Feulgen reaction, Auramine O-Feulgen reaction, 
Ethidium Bromide, Propidium iodide, high affinity DNA fluorophores, 
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Green Fluorescent Protein fused to DNA binding protein, ACMA, 
Quinacrine and Acridine Orange, Feulgen reagent, Gallocyanin chrom- » - 
alum, Gallocyanin chrom-alura and naphfhol yellow S, Methyl green- 
pyronin Y and Thionin-Feulgen reagent. 

5 According to still further features in the described preferred 

embodiments the spectral data collection device is selected from the group 
consisting of ah interferometer-based spectral data collection device, filters- 
based spectral data collection device and a dispersion element-based 
spectral data collection device. 

10 According to still further features in the described preferred 

embodiments each of the first and second immunohistochemical stains 
independently includes a primary antibody. 

According to still further features in the described preferred 
embodiments the primary antibody is selected from the group consisting of 

15 anti-estrogen receptor antibody, anti-progesterone receptor antibody, anti- 
p53 antibody, anti-Her-2/neu antibody, anti-EGFR antibody, anti-cathepsin 
D antibody, anti-Bcl-2 antibody, anti-E-cadherin antibody, anti-CA125 
antibody, anti-CA15-3 antibody, anti-CA19-9 antibody, anti-c-erbB-2 
antibody, anti-P-glycoprotein antibody, anti-CEA antibody, anti- 

20 retinoblastoma protein antibody, anti-ras oncoprotein antibody, anti-Lewis 
X antibody, anti-Ki-67 antibody, anti-PCNA antibody, anti-CD3 antibody, 
anti-CD4 antibody, anti-CD5 antibody, anti-CD7 antibody, anti-CD8 
antibody, anti-CD9/p24 antibody, anti-CDIO antibody, anti-CDllc 
antibody, anti-CD 13 antibody, anti-CD 14 antibody, anti-CD 15 antibody, 

25 anti-CD19 antibody, anti-CD20 antibody, anti-CD22 antibody, anti-CD23 
antibody, anti-CD30 antibody, anti-CD31 antibody, anti-CD33 antibody, 
anti-CD34 antibody, anti-CD35 antibody, anti-CD38 antibody, anti-CD41 
antibody, anti-LCA/CD45 antibody, anti-CD45RO antibody, anti-CD45RA 
antibody, anti-CD39 antibody, anti-CDIOO antibody, anti-CD95/Fas 

30 antibody, anti-CD99 antibody, anti-CD 106 antibody, anti-ubiquitin 
antibody, anti-CD71 antibody, anti-c-myc antibody, anti-cytokeratins 
antibody, anti-vimentins antibody, anti-HPV proteins antibody, anti-kappa 
light chains antibody, anti-lambda light chains antibody, anti-melanosomes 
antibody, anti-prostate specific antigen antibody, anti-S-100 antibody, anti- 

35 tau antigen antibody, anti-fibrin antibody, anti-keratins antibody and anti- 
Tn-antigen antibody. 

The present invention successfully addresses the shortcomings of the 
presently known configurations by providing a method of simultaneous in . 
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situ analysis of a plurality of immunohistochemical stains, histological 
stains and DNA ploidy stains, using spectral imaging techniques of high > 
spatial and spectral resolutions. 

rktf.p DESCRIPTION OF THE DRAWINGS 

The invention herein described, by way of example only, with 
reference to the accompanying drawings, wherein: 

FIG. 1 is a block diagram illustrating the main components of an 
imaging spectrometer constructed in accordance with U.S. Pat application 
No. 08/392,019 (prior art). 

FIG. 2 illustrates a non-moving type interferometer, namely, a 
Sagnac interferometer, as used in an imaging spectrometer in accordance 
with U.S. Pat application No. 08/392,019 (prior art). 

FIGs. 3a-c show interphase FISH performed with two different 
probes attached to Texas-Red and Rhodamine wherein (a) is an original 
image, the way it looks thorough a microscope; (b) is the same sample, after 
being measured and processed by the SPECTRACUBE™ system; and (c) 
are the fluorescence spectra of the Texas-Red and Rhodamine fluorophores. 

FIGs. 4a-c show interphase FISH performed using the 
SPECTRACUBE™ system with six different probes each labeled with a 
different fluorophore wherein (a) is an original image, the way it looks 
thorough a microscope, cells were counter stained with DAPI; (b) is the 
same sample, after being measured and processed by the SPECTRACUBE 
™ system; and (c) are the fluorescence spectra of the six fluorophores which 
were employed for classification. 

FIGs. 5a-c present hybridization results of 24 chromosomal paints 
with a normal male chromosome spread using the SPECTRACUBE™ 
system, wherein Figure 5a is an RGB image obtained using an RGB 
algorithm, Figures 5b and 5c are classification images obtained using a 
classification algorithm, whereas Figures 5a and 5b present the original 
spread and Figure 5c presents the chromosome spread arranged as a 
karyotype. 

FIG. 6 shows a definition of pseudo-RGB (Red, Green and Blue) 
colors for emphasizing chosen spectral ranges. The intensity for each 
pseudo-color is calculated by integrating the area under the curve, after 
multiplying it by one of the curves. 

FIG. 7 presents non-normalized spectra of two histological stains 
(hematoxylin and eosin) and of four immunohistochemical stains (DAB, 
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Fast Red, AEC and BCIP/NBT) measured using the SPECTRACUBE™ 
system from six single stain stained breast cancer samples. Peak * - 
wavelengths are indicated on the right. 

FIGs. 8a-e show images of a breast cancer sample which was 
5 previously determined to be ER(+)/PR(+) co-stained with the histological 
stain hematoxylin and with the immunohistochemical stain anti-ER-DAB, 
wherein Figure 8a presents an RGB image of the sample, Figures 8b-d 
present binarized images of hematoxylin, DAB and AEC spectral 
components, respectively, whereas Figure 8e presents a classification 
10 overlay image, wherein the above spectral components are highlighted in 
red, green and blue, respectively, all as measured using the 
SPECTRACUBE™ system. 

FIGs. 9a-e show images of a breast cancer sample which was 
previously determined to be ER(+)/PR(+) co-stained with the histological 
15 stain hematoxylin and with the immunohistochemical stain anti-PR- AEC, 
wherein Figure 9a presents an RGB image of the sample, Figures 9b-d 
present binarized images of hematoxylin, DAB and AEC spectral 
components, respectively, whereas Figure 9e presents a classification 
overlay image, wherein the above spectral components are highlighted in 
20 red, green and blue, respectively, all as measured using the 
SPECTRACUBE™ system. 

FIGs. lOa-e show images of a breast cancer sample which was 
previously determined to be ER(+)/PR(+) co-stained with the histological 
stain hematoxylin and with the immunohistochemical stain anti-PR-Fast 
25 Red, wherein Figure 10a presents an RGB image of the sample, Figures 
lOb-d present binarized images of hematoxylin, DAB and Fast Red spectral 
components, respectively, whereas Figure lOe presents a classification 
overlay image, wherein the above spectral components are highlighted in 
red, green and blue, respectively, all as measured using the 
30 SPECTRACUBE™ system. 

FIGs. lla-e show images of a breast cancer sample which was 
previously determined to be ER(+)/PR(+) co-stained with the histological 
stain hematoxylin and with the immunohistochemical stains anti-ER-DAB 
and anti-PR-Fast Red, wherein Figure 11a presents an RGB image of the 
35 sample, Figures llb-d present binarized images of hematoxylin, DAB and 
Fast Red spectral components, respectively, whereas Figure lie presents a 
classification overlay image, wherein the above spectral components are 
highlighted in red, green and blue, respectively, regions co-stained with 
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anti-ER-DAB and anti-PR-Fast Red are shown in yellow, all as measured 
using the SPECTRACUBE™ system. 

FIGs. 12a-f show images of a breast cancer sample which was 
previously determined to be ER(+)/PR(+) co-stained with the histological 
stains hematoxylin and eosin and with the immunohistochemical stains anti- 
ER-DAB and anti-PR-Fast Red, wherein Figure 12a presents an RGB image 
of the sample, Figures 12b-e present binarized images of hematoxylin, 
eosin, DAB and Fast Red spectral components, respectively, whereas Figure 
12f presents a classification overlay image, wherein the above spectral 
components are highlighted in blue, purple green and red, respectively, all 
as measured using the SPECTRACUBE™ system. 

FIG. 13 presents non-normalized spectra of five histological stains 
(Harris hematoxylin, eosin, orange G, light green SF and Bismark brown Y) 
measured using the SPECTRACUBE™ system from five single stain 
stained cervix cancer samples. Peak wavelengths are indicated on the right. 

FIGs. 14a-g show images of a cervix cancer sample co-stained with 
the histological stains Harris hematoxylin, eosin, orange G, light green SF 
and Bismark brown Y, which collectively form what is known in the art as 
Papanicolaou stain, wherein Figure 14a presents an RGB image of the 
sample, Figures 14b-f present binarized images of Harris hematoxylin, 
eosin, orange G, light green SF and Bismark brown Y spectral components, 
respectively, whereas Figure 14e presents a classification overlay image, 
wherein the above spectral components are highlighted in blue, pink, 
orange, green and gray, respectively, to form by combinations thereof the 
colorful classification overlay image, all as measured using the 
SPECTRACUBE™ system. 

DESCRIPTION OF THE PKHFF.RRRD FMBODTMENTS 

The present invention is of a method of simultaneous in situ analysis 

of a plurality of immunohistochemical stains, histological stains and/or 

DNA ploidy stains which can be used in pathological examination of cells. 

Specifically, the present invention can be used to provide a pathologist with 

cumulative information regarding an examined biological sample and assist 

in decision making. 

The principles and operation of a method according to the present 

invention may be better understood with reference to the drawings and 

accompanying descriptions. 
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. Before explaining at least one embodiment of the invention in detail, 
it is to be understood that the invention is not limited in its application to the , . 
details of construction and the arrangement of the components set forth in 
the following description or illustrated in the drawings. The invention is 
5 capable of other embodiments or of being practiced or carried out in various 
ways. Also, it is to be understood that the phraseology and terminology 
employed herein is for the purpose of description and should not be 
regarded as limiting. 

Recent studies have shown that the optical mixtures of several 
10 absorbing stains can be analyzed in certain cases. Where the absorption 
bands of the individual stains do no overlap, the analysis is simple and 
straight forward. Wavelengths are selected where each component in turn 
displays an absorption adequate for measurement and the other components 
display negligible absorption. Thus one attenuation measurement at each 
15 chosen wavelength suffices to determine each individual stain in the 
mixture. This technique has been successfully used in pathology specimens 
by Bacus et al. [ibid.]. The advantages of this technique are that (i) it 
provides insight into the biochemical composition of the cell or tissue; (ii) 
image acquisition is simply performed by using narrow band filters. 
20 Unfortunately, current cytochemistry and histochemistry offer a very 
limited number of such dyes with nonoverlapping spectra. 

Thus, in accordance with one aspects of the teachings of the present 
invention there is provided a method of in situ analysis of a biological 
sample. The method is effected by executing the following method steps, in 
25 which, in a first step, the biological sample is stained with N (i.e., a plurality 
of) stains of which a first stain is a first immunohistochemical stain, a first 
histological stain or a first DNA ploidy stain, and a second stain is a second 
immunohistochemical stain, a second histological stain or a second DNA 
ploidy stain. 

io Provisions are taken such that N is an integer greater than three (e.g., 

4, 5, 6, 7, 8, 9, 10 or more, e.g., an integer between 11 and 50, inclusive) 
and further that (i) if the first stain is the first immunohistochemical stain 
then the second stain is either the second histological stain or the second 
DNA ploidy stain; (ii) if the first stain is the first histological stain then the 

35 second stain is either the second immunohistochemical stain or the second 
DNA ploidy stain; whereas (iii) if the first stain is the first DNA ploidy stain 
then the second stain is either the second immunohistochemical stain or the 
second histological stain. 
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In a second step of the method according to the present invention a 
spectral data collection device is used for collecting spectral data from the 
biological sample, the spectral data collection device and the N stains are 
selected such that a spectral component associated with each of the N stains 
is collectable. 

In accordance with another aspects of the teachings of the present 
invention there is provided another method of in situ analysis of a biological 
sample. The method is effected by executing the following method steps, in 
which, in a first step, the biological sample is stained with at least four 
different immunohistochemical stains. In a second step of the method a 
spectral data collection device is used for collecting spectral data from the 
biological sample, the spectral data collection device and the at least four 
immunohistochemical stains are selected such that a spectral component 
associated with each of the at least four immunohistochemical stains is 
collectable. 

In accordance with yet another aspects of the teachings of the present 
invention there is provided yet another method of in situ analysis of a 
biological sample. The method is effected by executing the following 
method steps, in which, in a first step, the biological sample is stained with 
at least three stains of which at least one stain is an immunohistochemical 
stain and at least one additional stain is a histological stain or a DNA ploidy 
stain. In a second step of the method, a spectral data collection device is 
used for collecting spectral data from the biological sample, the spectral 
data collection device and the at least three stains are selected such that a 
spectral component associated with each of the at least three stains is 
collectable. 

In accordance with still another aspects of the teachings of the 
present invention there is provided still another method of in situ analysis of 
a biological sample. The method is effected by executing the following 
method steps, in which, in a first step, the biological sample is stained with 
at least three stains of which a first stain is an immunohistochemical stain, a 
second stain is a histological stain and a third stain is a DNA ploidy stain. 
In a second step of the method, a spectral data collection device is used for 
collecting spectral data from the biological sample, the spectral data 
collection device and the at least three stains are selected such that a 
spectral component specifically associated with each of the at least three 
stains is collectable. 
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• In accordance with an additional aspects of the teachings of the 
present invention there is provided a immunohistochemical composition » - 
which includes in a mixture at least four different immunohistochemical 
stains, each being for staining a respective cytological marker in the 

5 biological sample and each being individually detectable in a presence of all 
others using a spectral data collection device. 

As used herein in the specification and in the claims section below, 
the term "in situ" or "in situ analysis" refers to an analysis of cellular or 
tissue components situated and preferably fixated in their natural place or 

10 position within the cell or tissue. 

As used herein in the specification and in the claims section below, 
the term "biological sample" refers to a sample retrieved from an animal, 
mammals and human beings in particular. The sample may be of a healthy 
tissue, disease tissue or tissue suspected of being disease tissue. The sample 

15 may be a biopsy taken, for example, during a surgical procedure. The 
sample may be collected via means of fine needle aspiration, scraping or 
washing a cavity to collects cells or tissue therefrom. The sample may be of 
a tumor both solid and hematopoietic tumors, as well as of neighboring 
healthy tissue. The sample may be a smear of individual cells or a tissue 

20 section. 

As used herein in the specification and in the claims section below, 
the term "stained" or "staining" refers to a process in which coloration is 
produced by foreign matter having penetrated into and/or interacted with the 
biological sample. 

25 As used herein in the specification and in the claims section below, 

the term "stain" or "stains" refers to colorants, either fluorescent, 
luminescent and/or non-fluorescent and further to reagents or matter used 
for effecting coloration. 

As used herein in the specification and in the claims section below, 

30 the term "immunohistochemical stain" refers to colorants, reactions and 
associated reagents in which a primary antibody which binds a cytological 
marker is used to directly or indirectly (via "sandwich" reagents and/or an 
enzymatic reaction) stain the biological sample examined. 
Immunohistochemical stains are in many cases referred to in the scientific 

35 literature as immunostains, immunocytostains, immunohistopathological 
stains, etc. 

As used herein in the specification and in the claims section below, 
the term "antibody" refers to any monoclonal or polyclonal 
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immunoglobulin, or a fragment of an immunoglobin such as sFv (single 
chain antigen binding protein), Fabl or Fab2. 

As used herein in the specification and in the claims section below, 
the term "histological stain" refers to any colorant, reaction and/or 

5 associated reagents used to stain cells and tissues in association with cell 
components such as types of proteins (acidic, basic), DNA, RNA, lipids, 
cytoplasm components, nuclear components, membrane components, etc. 
Histological stains are in many cases referred to as counterstains, 
cytological stains, histopathological stains, etc. 

10 As used herein in the specification and in the claims section below, 

the term lf DNA ploidy stain" refers to stains which stoichiometrically bind 
to chromosome components, such as, but not limited to, DNA or histones. 
When an antibody is involved, such as anti-histone antibody, such stains are 
also known as DNA immunoploidy stains. 

15 As used herein in the specification and in the claims section below, 

the term "spectral data collection device" refers to any device capable of 
detecting light intensity associated with a plurality, typically four or more, 
of distinct spectral bands in each spatial element (pixel) of the examined 
sample. For example, the SPECTRACUBE™ system optically connected to 

20 a microscope preferably serves as the spectral data collection device 
according to the present invention. However, any spectral imager, i.e., an 
instrument that measures and stores in memory for later retrieval and 
. analysis the spectrum of light emitted by every point of an object which is 
placed in its field of view, including filters (e.g., conventional, acousto- 

25 optic tunable filter (AOTF) or liquid-crystal tunable filter (LCTF)) and 
dispersive element (e.g., grating or prism) based spectral imagers, or other 
spectral data or multi-band light collection devices (e.g., a device in 
accordance with the disclosure in Speicher R. M., Ballard S. G. and Ward 
C. D. (1996) Karyotyping human chromosomes by combinatorial, multi- 

30 fluor FISH. Nature Genetics, 12:368-375) can be used to acquire the 
required spectral data. Also a device which includes a plurality of wide 
band filters (fixed or tunable), as described in U.S. Pat. application No. 
08/917,213, filed August 25, 1997, and is incorporated by reference as if 
fully set forth herein, can be used as the spectral data collection device 

35 according to the present invention. Therefore, it is intended not to limit the 
scope of the present invention for use of any specific type of spectral data 
collection device, nor to any specific type of spectral imager. 
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Thus, the spectral data collection device can be an interferometer- 
based spectral data collection device, filter(s)-based spectral data collection * - 
device and a dispersion element-based spectral data collection device. 

As used herein in the specification and in the claims section below, 
5 the term "spectral component" refers to a part of a spectrum which is unique 
to a specific substance and therefore may be used as a spectral signature of 
that substance, to differentiate that substance from other substances. 

According to one embodiment of the present invention the 
immunohistochemical stains each independently includes a primary 
10 antibody and a signal amplification mechanism. The signal amplification 
mechanism can employ, for example, a secondary antibody capable of 
binding a constant region of the primary antibody, avidin or strepavidin 
capable of binding biotin conjugated to the primary antibody, and biotin 
capable of binding avidin or strepavidin conjugated to the primary antibody. 
15 According to a preferred embodiment of the present invention, the 

secondary antibody, avidin, strepavidin or biotin are each independently 
labeled with a detectable moiety, which can be an enzyme directing a 
colorimetric reaction of a substrate having a substantially non-soluble color 
reaction product, a fluorescent dye (stain), a luminescent dye or a non- 
20 fluorescent dye. Examples concerning each of these options are listed 
hereinbelow. 

The enzyme employed can be, for example, alkaline phosphatase, 
horseradish peroxidase, f}-galactosidase and/or glucose oxidase; and the 
substrate can respectively be an alkaline phosphatase, horseradish 
25 peroxidase, p-galactosidase or glucose oxidase substrate. 

The enzyme can also be directed at catalyzing a luminescence 
reaction of a substrate, such as, but not limited to, luciferase and aequorin, 
having a substantially non-soluble reaction product capable of 
luminescencing or of directing a second reaction of a second substrate, such 
30 as but not limited to, luciferine and ATP or coelenterazine and Ca - * -4 ", 
having a luminescencing product. 

Examples for optional histological and DNA ploidy stains which can 
be employed while implementing the methods of the present invention are 
given hereinunder. 

35 According to a most preferred embodiment of the present invention 

each of the immunohistochemical stains employed includes a primary 
antibody. 
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According to yet another preferred embodiment of the present 
invention external calibration is employed to account for day-to-day » - 
variations experienced when staining is attempted. Thus, at least one 
calibration is preferably attempted for every staining batch. To this end, 

5 calibration material is employed, wherein the biological sample and the 
calibration material are stained at the same time with the same staining 
solutions. The spectral data collection device is first used to analyze the 
stained calibration material such that adjustment thereof or extraction of 
calibrating data for algorithmic post measurement calibration becomes 

10 feasible. Only then the biological sample can be more meaningfully 
analyzed, taking into account a calibration based correction. One ordinarily 
skilled in the art would know how to devise a calibrating algorithm to 
compensate for day-to-day variations experienced when staining is 
attempted. 

15 The calibration material can be an optical density reference material. 

Alternatively, the calibration material can include control cells which are 
simultaneously co-stained 1 together with the examined biological sample. 

The following lists various dyes or stains which can be used to 
implement the methods of the present invention. Further included is a list 

20 of natural cell constituents having a detectable spectral signature which can 
be co-detected with the stains using the methods of the present invention. 

It will be appreciated by one ordinarily skilled in the art that some 
staining procedures may interfere with others. Therefore the type of stains 
employed and their sequence of application should be well considered. 

25 These considerations can be applied by one ordinarily skilled in the art, 
knowing the staining procedures. 

Immunohistochemical stains for use in transmittance microscopy: In 
principle, any enzyme that (i) can be conjugated to or bind indirectly to 
(e.g., via conjugated avidin, strepavidin, biotin, secondary antibody) a 

30 primary antibody, and (ii) uses a soluble substrate to provide an insoluble 
product (precipitate) could be used. Such enzymes include, for example, 
HRP, AP, LacZ and glucose oxidase. 

Alkaline phosphatase (AP) substrates include, but are not limited to, 
AP-Blue substrate (blue precipitate, Zymed catalog p. 61); AP-Orange 

35 substrate (orange, precipitate, Zymed), AP-Red substrate (red, red 
precipitate, Zymed), 5-bromo, 4-chloro, 3-indolyphosphate (BCD? substrate, 
turquoise precipitate), 5-bromo, 4-chloro, 3-indolyl phosphate/nitroblue 
tetrazolium/ iodonitrotetrazolium (BCIP/INT substrate, yellow-brown 
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precipitate, Biomeda), 5-bromo, 4-chloro, 3-indolyphosphate/nitroblue 
tetrazolium (BCIP/NBT substrate, blue/purple), 5-bromo, 4-chloro, 3- * - 
indolyl phosphate/nitroblue tetrazolium/iodonitrotetrazolium 

(BCIP/NBT/INT, brown precipitate, DAKO, Fast Red (Red), Magenta-phos 

5 (magenta), Naphthol AS-BI-phosphate (NABP)/Fast Red TR (Red), 
Naphthol AS-BI-phosphate (NABP)/New Fuchsin (Red), Naphthol AS- 
MX-phosphate (NAMP)/New Fuchsin (Red), New Fuchsin AP substrate 
(red), p-Nitrophenyl phosphate (PNPP, Yellow, water soluble), VECTOR™ 
Black (black), VECTOR™ Blue (blue), VECTOR™ Red (red), Vega Red 

10 (raspberry red color), 

Horseradish Peroxidase (HRP, sometimes abbreviated PO) substrates 
include, but are not limited to, 2,2' Azino-di-3-ethylbenz-thiazoline 
sulfonate (ABTS, green, water soluble), aminoethyl carbazole, 3-amino, 9- 
1 ethylcarbazole AEC (3A9EC, red). Alpha-naphthol pyronin (red), 4-chloro- 

15 1 -naphthol (4C1N, blue, blue-black), 3,3'-diaminobehzidine 
tetrahydrochloride (DAB, brown), ortho-dianisidine (green), o-phenylene 
diamine (OPD, brown, water soluble), TACS Blue (blue), TACS Red (red), 
3 9 3\5,y Tetramethylbenzidine (TMB, green or green/blue), TRUE BLUE™ 
(blue), VECTOR™ VIP (purple), VECTOR™ SG (smoky blue-gray), and 

20 Zymed Blue HRP substrate (vivid blue). 

Glucose Oxidase (GO) substrates, include, but are not limited to, 
nitroblue tetrazolium (NBT, purple precipitate), tetranitroblue tetrazolium 
(TNBT, black precipitate), 2-(4-iodophenyl)-5-(4-nitorphenyl)-3- 
phenyltetrazolium chloride (INT, red or orange precipitate), Tetrazolium 

25 blue (blue), Nitrotetrazolium violet (violet), and 3-(4,5-dimethylthiazol-2- 
yl)-2,5-diphenyltetrazoiium bromide (MTT, purple). All tetrazolium 
substrates require glucose as a co-substrate. The glucose gets oxidized and 
the tetrazolium salt gets reduced and forms an insoluble formazan which 
forms the color precipitate. 

30 Beta-Galactosidase substrates, include, but are not limited to, 5- 

bromo-4-chloro-3-indoyl beta-D-galactopyranoside (X-gal, blue 
precipitate). 

The precipitates associated with each of the substrates listed have 
unique detectable spectral signatures (components). 
35 Antibody which links heavy metals can be used for immunostaining 

using reflection contrast, bright-field or dark-field imaging, or electron 
microscopy. Such heavy metals include, but are not limited to, gold and 
silver, typically in a colloidal form. 
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The following references, which are incorporated herein provide 
additional examples. J.M Elias (1990) Immunohistopathology: A practical 
approach to diagnosis. ASCP Press (American Society of Clinical 
Pathologists), Chicago; J.F. McGinty, F.E. Bloom (1983) Double 
5 immunostaining reveals distinctions among opioid peptidergic neurons in 
the medial basal hypothalamus. Brain Res. 278: 145-153; and T. Jowett 
(1997) Tissue In situ Hybridization: Methods in Animal Development. John 
Wiley & Sons, Inc., New York; J Histochem Cytochem 1997 December 
45(12):1629-1641. 

10 Histolo gical stains for use in transmittance microscopy: The 

following lists some histological stains used in transmitted light 
microscopy: eosin, hematoxylin, Orange G, Light Green SF, Romanowsky- 
Giemsa, May-Grunwald, Blue counterstain (Trevigen), ethyl green (CAS), 
Feulgen-naphthol yellow S, Giemsa, Methylene Blue, Methyl Green, 

15 pyronin, Naphthol-yellow, Neutral Red, Papanicolaou stain (which typically 
includes a mixture of Hematoxylin, Eosin Y, Light Green SF, Orange G and 
Bismarck Brown, Red Counterstain B (Trevigen), Red Counterstain C 
(Trevigen), and Sirius Red. 

DNA ploidy stains for use in transmittance microscopy : The 

20 following lists some DNA ploidy stains used in transmitted light 
microscopy. Feulgen reagent (pararosanilin), Gallocyanin chrom-alum, 
Gallocyanin chrom-alum and naphthol yellow S, Methyl green-pyronin Y, 
Thionin-Feulgen reagent, 

Immunohistochernical stains for use in fluorescen ce microscopy: 

25 Fluorescein, Rhodamine, Texas Red, Cy2, Cy3, Cy5, VECTOR Red, ELF™ 
(Enzyme-Labeled Fluorescence), CyO, Cy0.5, Cyl, CyL5, Cy3, Cy3.5, 
Cy5, Cy7, FluorX, Calcein, Calcein-AM, CRYPTOFLUOR™'S, Orange 
(42 kDa), Tangerine (35 kDa), Gold (31 kDa), Red (42 kDa), Crimson (40 
kDa), BHMP, BHDMAP, Br-Oregon, Lucifer Yellow, Alexa dye family, N- 

30 [6-(7-nitrobenz-2-oxa-l, 3-diazol-4-yl)arruno]caproyl] (NBD), BODIPY™, 
boron dipyrromethene difluoride, Oregon Green, MITOTRACKER™ Red, 
DiOC7(3), DilCig, Phycoerythrin, Phycobiliproteins BPE (240 kDa) RPE 
(240 kDa) CPC (264 kDa) APC (104 kDa), Spectrum Blue, Spectrum Aqua, 
Spectrum Green, Spectrum Gold, Spectrum Orange, Spectrum Red, NADH, 

35 NADPH, FAD, Infra-Red (IR) Dyes, Cyclic GDP-Ribose (cGDPR), 
Calcofluor White, Tyrosine and Tryptophan. 

Histological stains for use in fluorescence microscopy; 4',6- 
diamidino-2-phenylindole (DAPI), Eosin, Fluorescein isothiocyanate 
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(FITC), Hoechst 33258 and Hoechst 33342 (two bisbenzimides), Propidium 
Iodide, Quinacrine, Fluorescein-phalloidin and Resorufin, 

DNA ploidy stains for use in fluorescence — microscopy ; 

Chromomycin A 3, DAPI, Acriflavine-Feulgen reaction, Auramine O- 
Feulgen reaction, Ethidium Bromide, Propidium iodide, high affinity DNA 
fluorophores such as POPO, BOBO, YOYO and TOTO and others, Green 
Fluorescent Protein fused to DNA binding protein, such as histones, 
ACMA, Quinacrine and Acridine Orange. 

Endogenous pigments: Hemoglobin, myoglobin, porphyrin, 
hemosiderin and other ferrous pigments, lipofuscin, melanin, neuromelanin, 
ceroid a fluorescent oxidation product of lipid/protein, carotenoids, 
pyridine, flavin nucleotides. 

The following lists some primary antibodies known to specifically 
bind their associated cytological markers and which are presently employed 
as components in immunohistochemical stains used for research and, in 
limited cases, for diagnosis of various diseases. Anti-estrogen receptor 
antibody (breast cancer), anti-progesterone receptor antibody (breast 
cancer), anti-p53 antibody (multiple cancers), anti-Her-2/neu antibody 
(multiple cancers), anti-EGFR antibody (epidermal growth factor, multiple 
cancers), anti-cathepsin D antibody (breast and other cancers), anti-Bcl-2 
antibody (apoptotic cells), anti- E-cadherin antibody, anti-CA125 antibody 
(ovarian and other cancers), anti-CA15-3 antibody (breast cancer), anti- 
CA19-9 antibody (colon cancer), anti-c-erbB-2 antibody, anti-P- 
glycoprotein antibody (MDR, multi-drug resistance), anti-CEA antibody 
(carcinoembryonic antigen), anti-retinoblastoma protein (Rb) antibody, anti- 
ras oncoprotein (p21) antibody, anti-Lewis X (also called CD15) antibody, 
anti-Ki-67 antibody (cellular proliferation), anti-PCNA (multiple cancers) 
antibody, anti-CD3 antibody (T-cells), anti-CD4 antibody (helper T cells), 
anti-CD5 antibody (T cells), anti-CD7 antibody (thymocytes, immature T 
cells, NK killer cells), anti-CD8 antibody (suppressor T cells), anti- 
CD9/p24 antibody (ALL), anti-CD 10 (also called CALLA) antibody 
(common acute lymphoblasic leukemia), anti-CDllc antibody (Monocytes, 
granulocytes, AML), anti-CD 13 antibody (myelomonocytic cells, AML), 
anti-CD 14 antibody (mature monocytes, granulocytes), anti-CD 15 antibody 
(Hodgkin's disease), anti-CD19 antibody (B cells), anti-CD20 antibody (B 
cells), anti : CD22 antibody (B cells), anti-CD23 antibody (activated B cells, 
CLL), anti-CD30 antibody (activated T and B cells, Hodgkin's disease), 
anti-CD31 antibody (angiogenesis marker), anti-CD33 antibody (myeloid 
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cells, AML), anti-CD34 antibody (endothelial stem cells, stromal tumors), 
anti-CD35 antibody (dendritic cells), anti-CD38 antibody (plasma cells, * 
activated T, B, and myeloid cells), anti-CD41 antibody (platelets, 
megakaryocytes), anti-LCA/CD45 antibody (leukocyte common antigen), 

5 anti-CD45RO antibody (helper, inducer T cells), anti-CD45RA antibody (B 
cells), anti-CD39, CD 100 antibody, anti-CD95/Fas antibody (apoptosis), 
anti-CD99 antibody (Ewings Sarcoma marker, MIC2 gene product), anti- 
CD 106 antibody (VCAM-1; activated endothelial cells), anti-ubiquitin 
antibody (Alzheimer's disease), anti-CD71 (transferrin receptor) antibody, 

10 anti-c-myc (oncoprotein and a hapten) antibody, anti-cytokeratins 
(transferrin receptor) antibody, anti-vimentins (endothelial cells) antibody 
(B and T cells), anti-HP V proteins (human papillomavirus) antibody, anti- 
kappa light chains antibody (B cell), anti-lambda light chains antibody (B 
cell), anti-melanosomes (HMB45) antibody (melanoma), anti-prostate 

15 specific antigen (PSA) antibody (prostate cancer), anti-S-100 antibody 
(melanoma, salvary, glial cells), anti-tau antigen antibody (Alzheimer's 
disease), anti-fibrin antibody (epithelial cells), anti-keratins antibody, and 
anti-Tn-antigen antibody (colon carcinoma, adenocarcinomas, and 
pancreatic cancer). 

20 Table 2 below provides few examples of sets of markers having 

prognostic and/or therapeutic significance in various cancers: 



TABLE 2 



Cancer 


DNA 
Ploidy 


ER 


PR 


p53 


her-2/ 
neu 


Ki-67 


p21 ras 


pRB 


CD31 


Breast 


X 


X 


X 
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X 


X 
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Ovarian 


X 






X 


X 


X 






X 


Bladder 


X 






X 




X 




X 


X 


Colorectal 


X 






X 




X 


X 




X 


Prostate/ 
Bladder 


X 






X 




X 




X 


X 



25 

A breast cancer panel therefore can include the anti-ER, anti-PR, 
anti-Her2/neu, anti-p53, anti-Ki-67 and anti-CD31 immunohistochemical 
marker stains, a DNA ploidy stain and a H&E counterstain. 
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Ovarian and/or endometrial cancer panel can therefore include the 
anti-Her2/neu, anti-p53, anti-Ki-67 and anti-CD31 immunohistochemical 
stains, a DNA ploidy stain and a H&E counterstain. 

Prostrate and/or bladder cancer panel can therefore include the anti- 
Ki-67, anti-p53, anti-CD31 and anti-retinoblastoma protein (Rb) marker 
stains, a DNA ploidy stain and a H&E counterstain. 

Whereas a colorectal cancer panel can therefore include the anti-Ki- 
67, anti-p53, anti-CD31 and anti-p21 (ras oncoprotein) marker stains, a 
DNA ploidy stain and a H&E counterstain. 

The present invention as herein described has several advantages 
over prior art methods in which high resolution imaging was combined with 
very low and inefficient spectral resolution (typically two discrete spectral 
bands) for co-detection of two stains, because using a spectra collection 
device as herein described, characterized by high spatial and spectral 
resolutions enables to co-detect any desired numbers of stains even when 
the stains employed are very similar spectrally. 

Thus according to the present invention a clinician can 
simultaneously detect multiple cytological markers with 
prognostic/therapeutic significance (e.g.; ER, PR, p53, her-2/neu, Ki-67 and 
CD31), significant changes in DNA ploidy and in sample staining with 
conventional histological stains. The clinician can therefore manage and 
monitor patient therapy with improved accuracy (e.g., select appropriate 
therapeutic regimen), reduce patient management costs through more 
accurate diagnosis, and reduce hospital costs through more efficient 
sampling. 

Scanning fields of the stained biological sample according to the 
present invention can be effected manually, semi-automatically or 
automatically, as well known in the art, using for example slide loading and 
scanning devices. For complete DNA ploidy analysis typical 200 cells, 
preferably more, should be analyzed. Pattern recognition and spectrally 
resolved pattern recognition approaches can be used to enhance analysis and 
diagnosis. 

There present invention, according to which a method is provided of 
simultaneous in situ analysis of a plurality of immunohistochemical stains, 
histological stains and DNA ploidy stains, using spectral imaging 
techniques of high spatial and spectral resolutions has numerous advantages 
over the prior art. First it enables simultaneous detection of a plurality of 
stains and therefore it is effort and cost-effective. Second, it enables the 
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simultaneous detection of a plurality of stains on the same cells or tissue, 
while according to the prior art, these is not applicable for more than two or 
three stains. Third, it enabled dissociating among very similar spectra, 
while the prior art required the use of very distinctive stains. 

5 

EXAMPLES 

Reference is now made to the following examples, which together 
with the above descriptions, illustrate the invention in a non limiting 
fashion. 

10 

EXAMPLE 1 
The Measurement Apparatus and its Performances 
Figure 1 is a block diagram illustrating the main components of a 
prior art imaging spectrometer disclosed in U.S. Pat application No. 
15 08/392,019 to Cabib et al, filed Feb. 21st, 1995, now U.S. Pat No. 
5,539,517, issued Jul. 23, 1996, which is incorporated by reference as if 
fully set forth herein. 

This imaging spectrometer is constructed highly suitable to 
implement the method of the present invention as it has high spectral (Ca. 4- 
20 14 nm depending on wavelength) and spatial (Ca. 30/M fxm where M is the 
effective microscope or fore optics magnification) resolutions. 

Thus, the prior art imaging spectrometer of Figure 1 includes: a 
collection optical system, generally designated 20; a one-dimensional 
scanner, as indicated by block 22; an optical path difference (OPD) 
25 generator or interferometer, as indicated by block 24; a one-dimensional or 
two-dimensional detector array, as indicated by block 26; and a signal 
processor and display, as indicated by block 28. 

A critical element in system 20 is the OPD generator or 
interferometer 24, which outputs modulated light corresponding to a 
30 predetermined set of linear combinations of the spectral intensity of the 
light emitted from each pixel of the scene to be analyzed. The output of the 
interferometer is focused onto the detector array 26. Thus, all the required 
optical phase differences are scanned simultaneously for all the pixels of the 
field of view, in order to obtain all the information required to reconstruct 
35 the spectrum. The spectra of all the pixels in the scene are thus collected 
simultaneously with the imaging information, thereby permitting analysis of 
the image in a real-time manner. 
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The apparatus according to U.S. Pat. No. 5,539,517 may be practiced 
in a large variety of configurations. Specifically, the interferometer used » 
may be combined with other mirrors as described in the relevant Figures of 
U.S. Pat. No. 5,539,517. 

Thus, according to U.S. Pat. No. 5,539,517 alternative types of 
interferometers may be employed. These include (i) a moving type 
interferometer in which the OPD is varied to modulate the light, namely, a 
Fabry-Perot interferometer with scanned thickness; (ii) a Michelson type 
interferometer which includes a beamsplitter receiving the beam from an 
optical collection system and a scanner, and splitting the beam into two 
paths; (iii) a Sagnac interferometer optionally combined with other optical 
means in which interferometer the OPD varies with the angle of incidence 
of the incoming radiation, such as the four-mirror plus beamsplitter 
interferometer as further described in the cited U.S. patent (see Figure 14 
there). 

Figure 2 illustrates an imaging spectrometer constructed in 
accordance with U.S. Pat. No. 5,539,517, utilizing an interferometer in 
which the OPD varies with the angle of incidence of the incoming radiation. 
A beam entering the interferometer at a small angle to the optical axis 
undergoes an OPD which varies substantially linearly with this angle. 

In the interferometer of Figure 2, all the radiation from source 30 in 
all the pixels, after being collimated by an optical collection system 31, is 
scanned by a mechanical scanner 32. The light is then passed through a 
beamsplitter 33 to a first reflector 34 and then to a second reflector 35, 
which reflects the light back through the beamsplitter 33 and then through a 
focusing lens 36 to an array of detectors 37 (e.g., a CCD). This beam 
interferes with the beam which is reflected by 33, then by second reflector 
35, and finally by first reflector 34. 

At the end of one scan, every pixel has been measured through all the 
OPD's, and therefore the spectrum of each pixel of the scene can be 
reconstructed by Fourier transformation. A beam parallel to the optical axis 
is compensated, and a beam at an angle (6) to the optical axis undergoes an 
OPD which is a function of the thickness of the beamsplitter 33, its index of 
refraction, and the angle 6. The OPD is proportional to 6 for small angles. 
By applying the appropriate inversion, and by careful bookkeeping, the 
spectrum of every pixel is calculated. 

In the configuration of Figure 2 the ray which is incident on the 
beamsplitter at an angle /5 (fi = 45° in Figure 2) goes through the 
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interferometer with an OPD « 0, whereas a ray which is incident at a 

general angle fi - 6 undergoes an OPD given by Equation 2: 

(1) OPD(/5,6,'>") = f[(n 2 -sin 2 (y&f 6)) 0 ' 5 - (H 2 -sin 2 (/>-6)) 0 - 5 + 2sin/3sin6 

] 

where 6 is the angular distance of a ray from the optical axis or 
interferometer rotation angle with respect to the central position; t is the 
thickness of the beamsplitter; and n is the index of refraction of the 
beamsplitter. 

It follows from Equation 2 that by scanning both positive and 
negative angles with respect to the central position, one gets a double-sided 
interferogram for every pixel, which helps eliminate phase errors giving 
more accurate results in the Fourier transform calculation. The scanning 
amplitude determines the maximum OPD reached, which is related to the 
spectral resolution of the measurement. The size of the angular steps 
determines the OPD step which is, in turn, dictated by the shortest 
wavelength to which the system is sensitive. In fact, according to the 
sampling theorem [see, Chamberlain (1979) The principles of 
interferometric spectroscopy, John Wiley and Sons, pp. 53-55], this OPD 
step must be smaller than half the shortest wavelength to which the system 
is sensitive. 

Another parameter which should be taken into account is the finite 
size of a detector element in the matrix. Through the focusing optics, the 
element subtends a finite OPD in the interferometer which has the effect of 
convolving the interferogram with a rectangular function. This brings 
about, as a consequence, a reduction of system sensitivity at short 
wavelengths, which drops to zero for wavelengths equal to or below the 
OPD subtended by the element. For this reason, one must ensure that the 
modulation transfer function (MTF) condition is satisfied, i.e., that the OPD 
subtended by a detector element in the interferometer must be smaller than 
the shortest wavelength at which the instrument is sensitive. 

Thus, imaging spectrometers constructed in accordance with the 
invention disclosed in U.S. Pat. No. 5,539,517 do not merely measure the 
intensity of light coming from every pixel in the field of view, but also 
measure the spectrum of each pixel in a predefined wavelength range. They 
also better utilize all the radiation emitted by each pixel in the field of view 
at any given time, and therefore permit, as explained above, a significant 
decrease in the frame time and/or a significant increase in the sensitivity of 
the spectrometer. Such imaging spectrometers may include various types of 
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interferometers and optical collection and focusing systems, and may 
therefore be used in a wide variety of applications, including medical 
diagnostic and therapy and biological research applications, as well as 
remote sensing for geological and agricultural investigations, and the like. 

5 As mentioned above, an imaging spectrometer in accordance with 

the invention disclosed in U.S. Pat. No. 5,539,517 was developed by 
Applied Spectral Imaging Ltd., Industrial Park, Migdal Haemek, Israel and 
is referred herein as SPECTRACUBE™. 

The SPECTRACUBE™ system has the following or better 

l o characteristics, listed hereinbelow in Table 3 : 

TABLE 3 

Parameter Performance 

15 

Spatial resolution: 30/M ism (M=effective microscope or fore 

optics magnification) 
Field of View: 1 5/M millimeters 

Sensitivity: 20 milliLux (for 1 00 msec integration time, 

20 increases for longer integration times linearly 

with VT) 

Spectral range: 400- 1 000 nm 

Spectral resolution: 4 nm at 400 nm (1 6 nm at 800 nm) 

Acquisition time: 5-50 sec, typical 25 sec 



25 



► - 



Acquisition ume: j-ju seu, lypuxu z,j 

FFT processing time: 20-1 80 sec, typical 60 sec 



The SPECTRACUBE™ system optically connected to a microscope 
is preferably used to analyze biological samples according to the method of 
the present invention. However, any spectral imager, i.e., an instrument that 

30 measures and stores in memory for later retrieval and analysis the spectrum 
of light emitted by every point of an object which is placed in its field of 
view, including filter (e.g., acousto-optic tunable filters (AOTF) or liquid- 
crystal tunable filter (LCTF)) and dispersive element (e.g., grating or prism) 
based spectral imagers, or other spectral data or multi-band light collection 

35 devices (e.g., a device in accordance with the disclosure in Speicher R. M., 
Ballard S. G. and Ward C. D. (1996) Karyotyping human chromosomes by 
combinatorial multi-flour FISH. Nature Genetics, 12:368-375) can be used 
to acquire the required spectral data. Also a device including a plurality of 
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wide-band of (fixed or tunable), as described in U.S. Pat, application No. 
08/917,213, filed August 25, 1997, and is incorporated by reference as if 
fully set forth herein, can be used as the spectral data collection device 
according to the present invention. Therefore, it is intended not to limit the 
scope of the present invention for use of any specific type of spectral data 
collection devices, nor any specific type of spectral imager. 

The power of the SPECTRACUBE™ system to resolve and 
differentiate between very similar spectra is demonstrated in Figures 3-5. 

To illustrate this capability, the reader is first referred to Figures 3a- 
c, which include an example of an interphase FISH measurement performed 
with chromosome 1 and chromosome 17 specific DNA probes tagged with 
the fluorophores Texas-Red and Rhodamine, respectively, whose 
fluorescence spectra are very similar. The chromosome 1 probe was a 
midsatellite probe for the subtelomeric region of the chromosome and was 
tagged with Texas-Red linked to the DNA probe via biotin post 
hybridization. The chromosome 17 probe was an a satellite probe for the 
centromeric region of the chromosome and was tagged with Rhodamine, 
linked to the second DNA probe via digoxigenin post hybridization. Figure 
3a shows the original image, the way it looks to the eye through the 
microscope. Figure 3b shows the same sample, after being measured and 
processed by the SPECTRACUBE™ system. Whereas Figure 3c shows the 
fluorescence spectra of the Texas-Red (marked as T) and Rhodamine 
(marked as R) fluorophores. 

As seen in Figure 3c, the spectral peaks of Texas-Red and 
Rhodamine differ merely by 15 nm, and therefore it would be very difficult 
to distinguish between theni using a filter-based system. 

Looking at a color FISH image through a microscope as shown in 
Figure 3a, the confidence level of recognizing the correct number of dots 
(marked 1-4) and of probe types appearing in the image is not particularly 
) high. As shown in Figure 3b, the SPECTRACUBE™ system, on the other 
hand, taking advantage of the spectrum measured for each pixel, is able 
both to verify the existence of the dots, to count them exactly, and to 
discriminate between the different pairs with a high level of confidence, due 
to the small spectral difference between them. By artificial coloring of 
5 Texas-Red and Rhodamine fluorescence, as shown in Figure 3c the location 
of probe specific fluorescence could be determined with high accuracy 
wherein dots 1 and 2 are of Texas-Red and dots 3 and 4 are of Rhodamine. 
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Figures 4a-b provide an example of FISH measurement after ^ 
hybridization of nuclear interphase DNA with six different probes. Figure 
4a shows the original image as perceived through a microscope. Figure 4b 
shows the same image following a SPECTRACUBE™ system 
measurement, spectral processing and artificial color display of all the 
detected pairs. Figure 4c shows the spectra of the six fluorophores after 
hybridization (marked according to the chromosomes each of which labels: 
1 8, 10, 11, 17 and X), as detected through a triple dichroic filter using the 
SPECTRACUBE™ system. For details regarding fluorophores, probes and 
, chromosomes the reader is referred to the following description, Table 3 
below and to Chroma Corp. Cat. No. 61 502) . 

It is apparent from Figure 4a, showing the original RGB image of the 
interphasic cell nucleus, that it is difficult to distinguish the colors from one 
another by eye or even by using a simple RGB color measurement. 
5 An experienced observer may, in the best case, detect three different 

colors of the six. Figure 4b, however, shows the same sample shown m 
Figure 4a, after processing the spectral data with a classification algorithms, 
and the resulting dots have been highlighted with artificial colors: orange, 
cyan, blue, yellow, green, and red, while the background was given a black 
20 artificial color. As observed, it is possible to see all the six pairs of 
fluorophores and to easily differentiate among the pairs. 

It should be further noted that one pair, the one highlighted in blue, 
can hardly be noticed by eye, or by using a color camera, however, it is 
detected after applying a background subtraction algorithm on the spectral 
25 cube (compare Figures 4a and 4b). 

The probes used were five a satellite probes for the centromenc 
regions of chromosomes 8, 10, 11, 17 and X, and a midsatellite probe for 
the subtelomeric region of chromosome 1. The fluorophores used to label 
each of the above chromosomes and the DAPI counter stain (background), 
30 their emission peak and artificial displayed color classification are 
summarized in Table 4, below. 

From the normalized spectral signatures of each of the six 
fluorophores shown in Figure 4c, it is clear that a system based on filters 
measuring at a few relatively wide spectral ranges, is not able to 
35 differentiate reliably between the different probe species, because of the 
large overlap between their spectra. Such a system is more dependent on 
the absolute measurement of the intensity of each probe, and therefore it is 
more affected by background signals and noise. It should be further noted 



WO 00/06774 



PCT/US99/16629 



66 



that spectral overlapping sometimes occurs also with auto-fluorescence 
originating from the cell itself. In this case too, the availability of spectral 
information for each pixel enables the elimination of the auto-fluorescence 
contribution, and yields more accurate results. 



TABLE 4 



Chromosome Fluorophore 



10 



15 



20 



25 



30 



35 



8 

1.0 

x 

1 

17 
11 

backg. 



SpectrumOrange™ 1 

SpectrumGreen™ 1 

Aqua 1 

Texas-Red 2 

FITC3 

Texas- Red 2 + FITC 3 
DAPI 4 



Emission 
peak 

588 nm 
538 nm 
480 nm 
615 nm 
525 nm 



Displayed 
color 

Brown 

Cyan 

Blue 

Yellow 

Green 



615, 525 nm Red 
Black 



1 obtained as labeled deoxymicleotides from Vysis, Downers Grove, IL, U.S.; 
conjugated via anti-digoxigenin antibody to pre hybridized digoxigenin containing 
probes; 3 fluorescein-5-iso-thiocyanate, conjugated via anti-biotin antibody to pre 
hybridized biotin containing probes; 4 4',6-diamidino-2-phenylindole used for counter 
staining. 

Figures 5a-c present hybridization results of normal male 
chromosomes using a combinatorial hybridization approach in accordance 
with the scheme disclosed in U.S. Pat. application No. 09/025,131, filed 
February 17, 1998, which is incorporated by reference as if folly set forth 
herein. 

Figure 5a is an RGB image of the chromosome spread obtained 
using an RGB algorithm. The RGB algorithm integrates the optical signal 
over the spectral range (e.g., 400 nm to 760 nm) of the CCD array to 
provide an RGB image of the chromosomes, in which each pixel is 
attributed a combination of red, green and blue intensities according to three 
weighting functions, {w r (X), w g (A), w b (W, which correspond to the 
tristimulus response functions for red (R), green (G) and blue (B). 
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In Figure 5q, the weighting functions w r , w e , wfc,. employed were 
simple square weighting functions, wherein for w r (red) M = 640 nm and X * 
2 = 750 nm; for w e (green) M = 555 nm and X 2 = 640 nm; and for w b 
(blue) Xi = 450 nm and X 2 = 555 nm. The simple weighting functions w r , 
5 Wp , w b are integrated to generate an RGB image of the chromosomes. 

Figures 5b is a classification image of the chromosome spread of 
Figure 5a. Figure 5c is the karyotype derived from the chromosome spread 
of Figure 5b. The classification image is calculated by a classification 
algorithm wherein each pixel is classified according its spectrum. One of 
10 the most important analysis algorithms is the spectral-based classification 
algorithm that enables multiple different spectra in the image to be 
identified and highlighted in classification-colors. This allows assignment 
of a specific classification-color to all human chromosomes based on their 
spectra This algorithm assumes that a reference spectrum of each 
15 chromosome has been measured and stored in a reference library in the 
computer. A distinguishing classification-color is assigned to each pixel in 
the image according to the classification-color assigned to the reference 
spectrum that is most similar to the spectrum at that given pixel, as defined, 
for example, by a minimal square error algorithm. 

20 

EXAMPLE 2 
Analyzing and Displaying the Results 
General: A spectral image is a three dimensional array of data, I(x,y, 
A), that combines spectral information with spatial organization of the 
25 image. As such, a spectral image is a set of data called a spectral cube, due 
to its dimensionality, which enables the extraction of features and the 
evaluation of quantities that are difficult, and in some cases even 
impossible, to obtain otherwise. Since both spectroscopy and digital image 
analysis are well known fields that are covered by an enormous amount of 
^0 literature [see, for example, Jain (1989) Fundamentals of Digital Image 
Processing, Prentice-Hall International], the following discussion will focus 
primarily on the benefit of combining spectroscopic and imaging 
information in a single data set i.e. , a spectral cube. 

One possible type of analysis of a spectral cube is to use spectral and 
35 spatial data separately, i.e., to apply spectral algorithms to the spectral data 
and two-dimensional image processing algorithms to the spatial data. 

As an example of a spectral algorithm, consider an algorithm 
computing the similarity between a reference spectrum and the spectra of all 
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pixels (U., similarity mapping) siting in a gray (^«*^*^ . - 
image (i.e., a similarity map) in whieh the tntensuy at each p«el ,s 
Tmpott onal to the degree of 'similarity. This gray sealeunage can *en b 
fijher analyzed using image proces.bg and computer vrsron technrques 
^ Lage enhancement, pattern recognition, etc.) to extract the desrred 
featrls L parameters. In other words, similarity mapprng mvolves 
£X of me absolute value rf*. diffcrenc. tb~-£ 

soecttum of each pixel of the spectral image wtth respect to a reference 
7£Z (either previously memorized in a library, or belongmg to a pore 
of tire sle or outer speetra. image), and displaymg a „ 
oseudocolor (black and white or color) image, m which the bnght ptxels 
C^nd to a small spectral difference, and dark pixe!s correspond ,0 a 
large spectral difference, or vice versa. ,„,,,«„„., 
Similarly, classification mapping perform the same calculanon as 
, describe* for similarity mapping, yet takes several spectra .u 

spectra and paints each pixel of the displayed .mage wtth a dtfferen 
pr—ned pseudocolor, according to its classification as bemg most 
similar to one of the several reference spectra. 

I, is also possible to apply spectral image algortthms based on non- 
» separable operations; i.e., algorithms <ha, include both Iocs specbul 
ntlmation and spatial correlation between adjacont ptxels (one of these 
ateorithms is, as will be seen below, a principal component analysts) 

8 One of me basic needs ft* arise natirrally when deahng wtu, any 
three-dimensional (3D) data structure such as a spectral cube 0*. 
„ is visualizing that data structure in a meaningful way. Unhke other of 
M 3D data such as topographic data, M obtained for extnnpte * » 
confocal microscope, where each point represent, m 
at a different location (*.y,z) in a trea-dimenstonal space, a spectral unage * 
a sequence of images representing the intensity of tire same two- 
,0 dimensional plane (i.e., the sample) at different wavelen to to 
reason, the two most intuitive ways to vrew a spectral cube of dah > to 
either view dre image plane (spatial data) or the intenstry of on p«el m a 
set of pixels as function of wavelength in a three-dunenstonal moumam- 
vtll^ dr"p.ay. in general, tire image plane can be used for disp aymg ^te 
35 the iLnsny measured a, any single wavelength or the gray scale tmage fca 
results after applying a spectral analysis algorithm, over a 
region, at every image pixel. The spectral axrs can, tn general, be used to 
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present the resultant spectrum of some spatial operation performed tn the ^ 
vicinity of any desired pixel (e.g., averaging the spectrum). 

I is possible, for example, to display the spectral .mage a a gmy 
scale image similar to the image that might be obtarned from a stmple . 

Zme clera or as a multicolor image utilising one or several 
r^"o "gmigh. and map import feature. Since sucha 
«n simply integrates me optical signal over the spectral range (e g. 400 
T to 760 L) oTflte CCD array, the "equivalent monochrome CCD 
Zl Z^L be computed from the 3D spectra, image da* base by 
a integrating along the spectral axis, as follows: 

gray_scaMx,y)= \^X)Hx,y,X)M (2) 

In equation 2, wffl is a general weighting response function that 
providL ZLm flexibility in computing a variety of gray scale tmages, 
SCT*. integration of an appropriately weighted 
1S over some spectral range. For example, by evaluattng equatton 2 wtm *ree 
Ift enTweighting functions, «*M*>. 
tristimuhts response functions for red (R) green OTj-J£ TO. 
resnectively, it is possible to display a convennonal RGB co or >™«e- 
rtL£. ^display meaning*, non — 1 

™ ^aae.! Fieure 6 presents an example of the power °i " r 
20 images, figure u i* Gaussian functions 

algorithm. Consider choosing {w r , w e , to be uau 

"inside" a spectrum of interest, the resulting pseudo-color image 

^TtZ^^ ^ data in &e spec r l regions 

JlSt ^e weighting fractions, enabling spectral differences in 
•,c thw three reeions to be detected more clearly. 

" : Point operations are defined as fltose mat are 

, a -rf. ™«ls fi e do not involve more than one pixel at a 

Z - eacfpixe, (intensity flection) into 
30 according to a predetermined transformation fimctron. A parttcular case of 
oi .reformation is me multiplication of tire tntenstty of e^h 
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./fc'afa^J image is framed in, another 

' ima8e one can now extend the definition of point operations to include 
One can nu different spectral images. An 

operations between ^ density analysis, 

important example of this W rf V. ' repreS ent regions 

Optica, density is employed to htghhgh t "*£*™ i Z iBm J** 

the transmrss.on spectrum. The cal ty ^ 
Lambert Beer law: 

a second cube; and (3) a spectrum from a library. 

response of the measuring y concentration, and in 
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the first cube and the selected spectrum; and (ii) applying a given scalar to 
the spectra of each of the pixels of the spectral image .by an arithmetical , 
function as described above. 

Such linear combinations may be used, for example, for background 
5 subtraction in which a spectrum of a pixel located in the background region 
is subtracted from the spectrum of each of the pixels; and for a calibration 
procedure in which a spectrum measured prior to sample analysis is used to 
divide the spectrum of each of the pixels in the spectral image. 

Another example includes a ratio image computation and display as a 
10 gray level image. This algorithm computes the ratio between the intensities 
at two different wavelengths for every pixel of the spectral image and paints 
each of the pixels in a lighter or darker artificial color accordingly. For 
example, it paints the pixel bright for high ratio, and dark for low ratio (or 
the opposite), to display distributions of spectrally sensitive materials. 
15 Spatial-spectral combined operations: In all of the spectral image 

analysis methods mentioned above, algorithms are applied to the spectral 
data The importance of displaying the spectrally processed data as an 
image is mostly qualitative, providing the user with a useful image. It is 
also possible, however, depending on the application, to use the available 
20 imaging data in even more meaningful ways by applying algorithms that 
utilize the spatial-spectral correlation that is inherent in a spectral image 
Spatial-spectral operations represent the most powerful types of spectral 
image analysis algorithms. As an example, consider the following situation: 
A sample contains k cell types stained with k different stains (the 
25 term 'cell' here is used both for a biological cell, and also as 'a region m the 
field of view of the instrument" ). Each stain has a distinct spectrum and 
binds to only one of the k cell types. It is important to find the average 
intensity per cell for each one of the k cell types. To achieve this task the 
following procedure can be used: (i) classify each pixel in the image as 
30 belonging to one of JfcH classes (* cell types plus a background) according 
to its spectrum; (2) segment the image into the various cell types and count 
the number of cells from each type; and (3) sum the special energy 
contributed by each class, and divide it by the total number of cells from the 

corresponding class. T u. 
35 This procedure makes use of both spectral and spatial data. The 

relevant spectral data takes the form of characteristic cell spectra (i.e., 
spectral "signatures"), while the spatial data consists of data about vanous 
types of cells (i.e., cell blobs) many of which appear similar to the eye. In 
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the above situation, colls can be differentiated by their characteristic 

generate a synthetio image in which eaeh ptxel ,s assigned one of M 
ZZ. Assuming mat the spectia of me different oell types are known to 

, , = 1, 2 , K JUft. «. end the measured speotrum at eaeh 

is *ift AefA,, «. men the foUowmg algorithm ,s a posstble 
method of classification (step 1 above): 

Let A- be the deviation of the measured spectrum from the known 
spectrum of me stain attache* to cell We i. Then, adopting a least-squares 

where * is the spectral reg^n of interest Each point [pixel (*, y)l in me 
taage can then be classified into one of me Wl classes usmg me followmg 
criterion: 

points) e class M if eh > threshold for all i S [1 A 
poX) e class p if threshold, and p is such e 2 p 

Steps 2 and 3 above (image segmentation and calculation of average 
intensity) are now straight-forward using standard computer vtston 
ZZli on the synthetic image created in accordance wtth the algonthm 
described in equations 6 and 7. 

Another approach is to express the measured spectrum s^X) at 
eachpixelasalinear combination of 

); f = \ 2> , fc In this case one would find the coefficient vector C 

[C1.C2, that solves: 

F =min 

Z(s(X)-s(X)f (8) 

A eft, 

where »(A) * 2T<* •*.(*). 

Solving for f -0; f -1.2 *<U.. values of « wWch 

JO yields Jmatrix equation C « J (9), where ^ is a square matrix of 
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dimension k with elements 
b = 



J (10), and B is a vector 



defined as ^ m,« = l,2 A (11). 

Arithmetic operations may similarly be applied to two or more 
spectral cubes and/or spectra of given pixels or from a library. For example 
5 consider applying an arithmetic operations between corresponding 
wavelengths of corresponding pairs of pixels belonging to a first spectral 
cube of data and a second spectral cube of data to obtain a resulting third 
spectral cube of data for the purpose of, for example, averaging two spectral 
cubes of data, time changes follow-up, spectral normalization, etc. 
0 In many cases objects (e.g., cells) present in a spectral image differ 

from one another in chemical constituents and/or structure to some degree, 
especially when stained. Using a decorrelation analysis, such as a principal 
component analysis, by producing covariance or a correlation matrix, 
enhances these differences. Decollation statistical analysis is directed at 
is extracting decollated data out of a greater amount of data, and average 
over the correlated portions thereof. There are a number of related 
statistical decorrelation methods. Examples include but not limited to 
principal component analysis (PCA), canonical variable analysis and 
singular value decomposition, etc., of these methods PCA is perhaps the 
20 more common one, and is used according to the present invention for 
decorrelation of spectral data, as this term is defined above. However, 
considering the fact that all decorrelation statistical methods including those 
listed above are related to one another, there is no intention to limit the 
scope of the invention to use of any specific decorrelation method. 
25 Specifically, there is no intention to limit the scope of the present invention 
to use of principal component analysis, as any other decorrelation statistical 
method may be alternatively employed. Information concerning the use and 
operation of the above listed decorrelation statistical methods is found in R. 
A Johnson and D. W. Wichen, "Applied Multivariate Statistical Analysis, 
third edition, Prentice Hall (1992) and T. W. Anderson, An Introduction to 
Multivariance Statistical Analysis, second edition, Wiley and Sons (1984), 
both are incorporated by reference as if fully set forth herein. 

Furthermore, as will become apparent from the descriptions to 
follow, the implementation of a decorrelation statistical method may be 
35 done using various modifications. As the concept of the present invention 
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is not dependent upon any specific modification, it is the intention that the 
scope of the present invention will not be limited to any specific . 
modification as described below. 

A brief description of the principal component analysis using a 

5 covariance matrix is given below. For further details regarding the principal 
component analysis, the reader is referred to Martens and Naes (1989) 
Multivariate Calibration, John Wiley & Sons, Great Britain; and to 
Esbensen et al., Eds. (1994) Multi variance analysis - in practice. 
Computer-aided modeling as CAMO, and the Unscrambled User's guide, 

io Trondheim, Norway. 

Thus, the intensities of the pixels of the image at wavelength X[ (i = 
1....N) are now considered a vector whose length is equal to the number of 
pixels q. Since there are N of these vectors, one for every wavelength of the 
measurement, these vectors can be arranged in a matrix B* with q rows, and 

15 N columns: 

No. of wavelengths 
"B u • • • "Bvn 

B' = No. of pixels - O 2 ) 

For each of the columns of matrix B' defined is an average: 
M,_-Z N (13) 

20 and a second normalized matrix B defined as: 

No. of wavelengths 

*u/ . . . 



B 



No. of pixels • ( 14 ) 



% x • ' • Aw 

A covariance matrix C is defined for the matrix B: C = BTB of 
dimensions NxN. C is diagonalized, and eigenvectors and eigenvalues 

25 related by: C V{ = Mt v i where Vi are N orth °g° nal unit vectors 311(1 Mi ^ 
the eigenvalues representing the variance in the direction of the i-th unit 
vector Vi. In general, the lowest components represent the highest 
variability as a function of pixels. 
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The products BV( (i = 1....A0 are the projections of the spectral image 
onto the elements of the orthogonal basis, They are vectors with q elements # . 
(q = number of pixels), and can be displayed separately as black and white 
images. These images may reveal features not obvious from a regular black 
and white image filtered at a certain wavelength or wavelength range. 

EXAMPLE 3 
Materials and Methods 

Breast cancer: 

Sample: All samples were obtained by from a 79 woman suffering 
from infiltrating ductal carcinoma, moderately differentiated. Samples were 
cross sectioned and prepared for staining following conventional protocols. 

Stainin g protocols: Staining was performed following standard 
Vantana or D AKO automated immunostaining protocols. 

Measurement: A microscope (Nikon Eclipse E-800) connected to a 
SPECTRACUBE™ system was adjusted for Koehler illumination with 
transmitted light lamp power to maximum voltage (12 V) for most stable 
illumination. Neutral density and color filters (FG3 and anti reflection 
filters) were introduced in the optical path to adjust intensity and spectral 
color balance. SPECTRACUBE acquisition parameters were 300 frames, 
512 virtual frames, wavelength range 440 to 760 nm, 176 ms/frame. 

First, "pure dye" i.e., hematoxylin, DAB, AEC and Fast Red (each 
stain alone) spectral cubes were acquired and representative spectra 
therefrom were used to form pure dyes spectral library. 

Then spectral cubes of each of the samples were acquired. And the 
SPECTRACUBE™ algorithms SpyView, as described in the 
SPECTRACUBE™ manual were employed to obtain RGB images, gray- 
level images of each spectral component, threshold binarized images and 
composite classification images thereof. 
Cervix cancer: 

Sample: A pap smear of a middle aged woman was collected 
following conventional procedures. 

Slowin g protocols: Staining was essentially as described in G. 
Papanicolaou (1942) A new procedure for staining vaginal smears. Science 
95: 438-439, which is incorporated by reference as if fully set forth herein. 

Measurement: A microscope (Nikon Eclipse E-800) connected to a 
SPECTRACUBE™ system was adjusted for Koehler illumination with 
transmitted light lamp power to maximum voltage (12 V) for most stable 



WO 00/06774 PCT/US99/16629 ' 

76 

illumination. Neutral density and color filters (FG3 and anti reflection 
filters) were introduced in the optical path to adjust intensity and spectral ^ 
color balance. SPECTRACUBE acquisition parameters were 300 frames, 
512 virtual frames, wavelength range 440 to 760 nm, 176 ms/frame. 
5 First, "pure dye" i.e., Harris hematoxylin, eosin, orange G, light 

green SF and Bismark brown Y (each stain alone) spectral cubes were 
acquired and representative spectra therefrom were used to form pure dyes 
spectral library. 

Then spectral cubes of the cervix cancer sample were acquired. And 
10 the SPECTRACUBE™ algorithms Spy View, as described in the 
SPECTRACUBE™ manual were employed to obtain RGB images, gray- 
level images of each spectral component, threshold binarized images and 
composite classification images thereof. 

l5 EXAMPLE 4 

Experimental Results 
Two well characterized experimental models served to demonstrate 
the feasibility and applicability of the methods according to the present 
invention: breast cancer and cervix cancer samples. 

20 Figure 7 presents non-normalized spectra of two histological stains 

(hematoxylin and eosin) and of four immunohistochemical stains (DAB, 
Fast Red, AEC and BCIP/NBT) measured using the SPECTRACUBE™ 
system from six single stain stained breast cancer samples. Peak 
wavelengths are indicated on the right. Please note that each of the stains 

25 has a characterizing spectrum, which, as further exemplified hereinbelow, 
enables simultaneous co-detection of spectral components associated with 
each of which. 

Figures 8-11 show such experiments. All images were measured 
using the SPECTRACUBE™ system and its various measurement and 

30 analysis algorithms, as described hereinabove. 

Figures 8a-e show images of a breast cancer sample which was 
previously and independently determined to be ER(+)/PR(+). The sample 
was co-stained with the histological stain hematoxylin and with the 
immunohistochemical stain anti-ER-DAB. Figure 8a presents an RGB 

35 image of the sample, using the RGB algorithm described hereinabove with 
respect to Figure 6. Figures 8b-d present binarized images of hematoxylin, 
DAB and AEC spectral components, respectively. These binarized images 
were obtained by thresholding gray-scale images showing the intensity of 
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each component in each pixel. Figure 8d serves. as a simulation for a PR(-) 
tumor. Figure 8e presents a classification overlay image,, wherein the above 
spectral components are highlighted in red, green and blue, respectively. 
Please note that as expected no AEC spectral components are detectable, 
yet, spectral components of both hematoxylin and DAB are readily 
detectable. The classification image assists the pathologist in evaluating the 
presence/absence/aggression level/diagnosis and/or prognosis of cancer 

cells or tissue examined. 

Figures 9a-e show images of a breast cancer sample which was 
previously and independently determined to be ER(+)/PR(+). This sample 
was also co-stained with the histological stain hematoxylin and with the 
immunohistochemical stain anti-PR-AEC. Figure 9a presents an RGB 
image of the sample. Figures 9b-d present binarized images of 
hematoxylin, DAB and AEC spectral components, respectively, whereas 
Figure 9e presents a classification overlay image, ^wherein the above 
spectral components are highlighted in red, green and blue, respectively. 
Please note that as expected no DAB spectral components are detectable, 
yet, spectral components of both hematoxylin and AEC are readily 
detectable. 

Figures lOa-e show images of a breast cancer sample which, like the 
former sample, was previously and independently determined to be 
ER(+)/PR(+). However, in this case the sample was co-stained with the 
histological stain hematoxylin and with the immunohistochemical stain anti- 
PR-Fast Red, which replaced the AEC previously used. Figure 10a presents 
an RGB image of the sample. Figures lOb-d present binarized images of 
hematoxylin, DAB and Fast Red spectral components, respectively. Figure 
lOe presents a classification overlay image, wherein the above spectral 
components are highlighted in red, green and blue, respectively. Please 
note that as expected no DAB spectral components, except for the artifact 
crystals formed especially in the lower part of the field, are detectable in 
this sample, yet, spectral components of both hematoxylin and Fast Red are 

readily detectable. 

Figures lla-e show images of a breast cancer sample which was 
previously and independently determined to be ER(+)/PR(+). The sample 
was co-stained with the histological stain hematoxylin and with the 
immunohistochemical stains anti-ER-DAB and anti-PR-Fast Red. Figure 
11a presents an RGB image of the sample. Figures 1 lb-d present binarized 
images of hematoxylin, DAB and Fast Red spectral components, 
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respectively. Figure lie presents a classification overlay image, wherein 
the above spectral components are highlighted in red, green and blue, 
respectively. Regions co-stained with anti-ER-DAB and anti-PR-Fast Red 
are shown in yellow. Please note that as expected hematoxylin, DAB, as 

5 well as Fast Red spectral components are readily detectable. 

Figures 12a-f show images of a breast cancer sample which was 
previously and independently determined to be ER(+)/PR(+). The sample 
was co-stained with the histological stains hematoxylin and eosin and with 
the immunohistochemical stains anti-ER-DAB and anti-PR-Fast Red. 

io Figure 12a presents an RGB image of the sample. Figures 12b-e present 
binarized images of hematoxylin, eosin, DAB and Fast Red spectral 
components, respectively. Figure 12f presents a classification overlay 
image, wherein the above spectral components are highlighted in blue, 
purple green and red, respectively, showing the ability of the 

15 SPECTRACUBE™ system to resolve four different spectral components. 
Thus, this example shows a stained breast cancer tissue section 
simultaneously showing staining to nuclei (hematoxylin), cytoplasm 
(eosin), estrogen receptor (ER, detected with anti-ER/HRP/DAB), and 
progesterone receptor (PR, detected with anti-PR/HRP/DAB). In the 

20 images show some ER(+) cells and fewer PR(+) cells. Different areas on 
entire slide represent interductal (ER(+)/PR(+)) and intraductal (ER(+)/PR(- 
)) carcinoma. This image shows a duct, so mostly ER(+)/PR(-) cancer cells 
were expected. 

Figure 13 presents non-normalized spectra of five histological stains 
25 (Harris hematoxylin, eosin, orange G, light green SF and Bismark brown Y) 
measured using the SPECTRACUBE™ system from five single stain 
stained cervix cancer samples. Peak wavelengths are indicated on the right. 

Figures 14a-g show images of a cervix cancer sample co-stained with 
the histological stains Harris hematoxylin, eosin, orange G, light green SF 
30 and Bismark brown Y, which collectively form what is known in the art as 
Papanicolaou (Pap) stain. Figure 14a presents an RGB image of the sample. 
Figures 14b-f present binarized images of Harris hematoxylin, eosin, orange 
G, light green SF and Bismark brown Y spectral components, respectively. 
Figure 14e presents a classification overlay image, wherein the above 
35 spectral components are highlighted in blue, pink, orange, green and gray, 
respectively, to form by combinations thereof the colorful classification 
overlay image shown. Please note that each of the stains employed has a 
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unique staining pattern which could be resolved only due to the high 
spectral and spatial resolutions of the SPECTRACUBE™ system employed. ^ 

The data presented herein demonstrates the usefulness of a device 
having high spectral and spatial resolutions in the analysis of biological 
5 samples co-stained with multiple stains. 

It will be appreciated by one ordinarily skilled in the art that the 
algorithms and displays used under this example, can be replaced by 
numerous other algorithms and displays, one example being the linear 
decomposition algorithm described in U.S. Pat. No. 08/984,990, which is 
10 incorporated by reference as if fully set forth herein. Using this algorithm 
will enable a researcher to obtain otherwise very similar and indicative 
results. 

15 Although the invention has been described in conjunction with 

specific embodiments thereof, it is evident that many alternatives, 
modifications and variations will be apparent to those skilled in the art. 
Accordingly, it is intended to embrace all such alternatives, modifications 
and variations that fall within the spirit and broad scope of the appended 

20 claims. 
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1. A method of in situ analysis of a biological sample 
comprising the steps of: 

(a) staining the biological sample with N stains of which a first 
stain is selected from the group consisting of a first 
immunohistochemical stain, a first histological stain and a first 
DNA ploidy stain, and a second stain is selected from the 
group consisting of a second immunohistochemical stain, a 
second histological stain and a second DNA ploidy stain, with 
provisions that N is an integer greater than three and further 
that: 

(i) if said first stain is said first immunohistochemical stain 
then said second stain is either said second histological 
stain or said second DNA ploidy stain; 

(ii) if said first stain is said first histological stain then said 
second stain is either said second immunohistochemical 
stain or said second DNA ploidy stain; whereas 

(iii) if said first stain is said first DNA ploidy stain then said 
second stain is either said second immunohistochemical 
stain or said second histological stain; and 

(b) using a spectral data collection device for collecting spectral 
data from said biological sample, said spectral data collection 
device and said N stains are selected such that a spectral 
component associated with each of said N stains is collectable. 

2. The method of claim 1, wherein said spectral data collection 
device is selected from the group consisting of an interferometer-based 
spectral data collection device, filters-based spectral data collection device 
and a dispersion element-based spectral data collection device. 

3. The method of claim 1, wherein said first and second 
immunohistochemical stains each independently includes a primary 
antibody. 

4. The method of claim 3, wherein said primary antibody is 
selected from the group consisting of anti-estrogen receptor antibody, anti- 
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progesterone receptor antibody, anti-p53 antibody, anti-Her-2/neu antibody, 
anti-EGFR antibody, anti-cathepsin D antibody, anti-Bcl-2 antibody, anti-E- # _ 
cadherin antibody, anti-CA125 antibody, anti-CA15-3 antibody, anti-CA19- 
9 antibody, anti-c-erbB-2 antibody, anti-P-glycoprotein antibody, anti-CEA 
antibody, anti-retinoblastoma protein antibody, anti-ras oncoprotein 
antibody, anti-Lewis X antibody, anti-Ki-67 antibody, anti-PCNA antibody, 
anti-CD3 antibody, anti-CD4 antibody, anti-CD5 antibody, anti-CD7 
antibody, anti-CD8 antibody, anti-CD9/p24 antibody, anti-CDIO antibody, 
anti-CDllc antibody, anti-CD13 antibody, anti-CD14 antibody, anti-CD15 
antibody, anti-CD 19 antibody, anti-CD20 antibody, anti-CD22 antibody, 
anti-CD23 antibody, anti-CD30 antibody, anti-CD31 antibody, anti-CD33 
antibody, anti-CD34 antibody, anti-CD35 antibody, anti-CD38 antibody, 
anti-CD41 antibody, anti-LCA/CD45 antibody, anti-CD45RO antibody, 
anti-CD45RA antibody, anti-CD39 antibody, anti-CD 100 antibody, anti- 
CD95/Fas antibody, anti-CD99 antibody, anti-CD 106 antibody, anti- 
ubiquitin antibody, anti-CD71 antibody, anti-c-myc antibody, anti- 
cytokeratins antibody, anti-vimentins antibody, anti-HPV proteins antibody, 
anti-kappa light chains antibody, anti-lambda light chains antibody, anti- 
melanosomes antibody, anti-prostate specific antigen antibody, anti-S-100 
antibody, anti-tau antigen antibody, anti-fibrin antibody, anti-keratins 
antibody and anti-Tn-antigen antibody. 

5. The method of claim 3, wherein said primary antibody is 
labeled with a detectable moiety. 

6. The method of claim 5, wherein said detectable moiety is a 
fluorescent dye. 

7. The method of claim 6, wherein said fluorescent .dye is 
selected from the group consisting of Fluorescein, Rhodamine, Texas Red, 
Cy2, Cy3, Cy5, VECTOR Red, ELF™ (Enzyme-Labeled Fluorescence), 
CyO, Cy0.5, Cyl, Cyl.5, Cy3, Cy3.5, Cy5, Cy7, FluorX, Calcein, Calcein- 
AM, CRYPTOFLUOR™^, Orange (42 kDa), Tangerine (35 kDa), Gold 
(31 kDa), Red (42 kDa), Crimson (40 kDa), BHMP, BHDMAP, Br-Oregon, 
Lucifer Yellow, Alexa dye family, N-[6-(7-nitrobenz-2-oxa-l, 3-diazol-4- 
yl)amino]caproyl] (NBD), BODIPY™, boron dipyrromethene difluoride, 
Oregon Green, MITOTRACKER™ Red, DiOC 7 (3), DilCig, 
Phycoerythrin, Phycobiliproteins BPE (240 kDa) RPE (240 kDa) CPC (264 
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kDa) APC (104 kDa), Spectrum Blue, Spectrum Aqua, Spectrum Green, 
Spectrum Gold, Spectrum Orange, Spectrum Red, NADH, NADPH, FAD, , . 
Infra-Red (IR) Dyes, Cyclic GDP-Ribose (cGDPR), Calcofluor White, 
Tyrosine and Tryptophan. 

8. The method of claim 5, wherein said detectable moiety is a 
non- fluorescent dye. 

9. The method of claim 8, wherein said non-fluorescent dye 
includes a heavy metal. 

10. The method of claim 5, wherein said detectable moiety is an 
enzyme catalyzing a colorimetric reaction of a substrate having a 
substantially non-soluble color reaction product. 

11. The method of claim 10, wherein said enzyme is selected 
from the group consisting of alkaline phosphatase, horseradish peroxidase, 
p-galactosidase, and glucose oxidase. 

12. The method of claim 10, wherein said substrate is selected 
from the group consisting of alkaline phosphatase substrates, horseradish 
peroxidase substrates, glucose oxidase substrates and beta-galactosidase 
substrates. 

13. The method of claim 5, wherein said detectable moiety is an 
enzyme catalyzing a luminescence reaction of a substrate having a 
substantially non-soluble reaction product capable of luminescencing or of 
chemical involvement in a second reaction with at least one additional 
substrate, said second reaction having a luminescencing product. 

14. The method of claim 13, wherein said enzyme is selected 
from the group consisting of alkaline phosphatase, horseradish peroxidase, 
p-galactosidase and glucose oxidase. 

15. The method of claim 13, wherein said first and at least one 
additional substrates are each independently selected from the group 
consisting of alkaline phosphatase, horseradish peroxidase, P-galactosidase 
and glucose oxidase substrates. 
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16. The method of claim 1, wherein said , first and second , . 
immunohistochemical stains each independently includes a primary 
antibody and a signal amplification mechanism. 

17. The method of claim 16, wherein said signal amplification 
mechanism is selected from the group consisting of a secondary antibody 
capable of binding a constant region of said primary antibody, avidin or 
strepavidin capable of binding biotin conjugated to said primary antibody 
and biotin capable of binding avidin or strepavidin conjugated to said 
primary antibody. 

18. The method of claim 14, wherein said secondary antibody, 
avidin, strepavidin and biotin are each independently labeled with a 
detectable moiety. 

19. The method of claim 18, wherein said detectable moiety is a 
fluorescent dye. 

20. The method of claim 19, wherein said fluorescent dye is 
selected from the group consisting of Fluorescein, Rhodamine, Texas Red, 
Cy2, Cy3, Cy5, VECTOR Red, ELF™ (Enzyme-Labeled Fluorescence), 
CyO, Cy0.5, Cyl, Cyl.5, Cy3, Cy3.5, Cy5, Cy7, FluorX, Calcein, Calcein- 
AM, CRYPTOFLUOR™*S, Orange (42 kDa), Tangerine (35 kDa), Gold 
(31 kDa), Red (42 kDa), Crimson (40 kDa), BHMP, BHDMAP, Br-Oregon, 
Lucifer Yellow, Alexa dye family, N-[6-(7-nitrobenz-2-oxa-l, 3-diazol-4- 
yl)amino]caproyl] (NBD), BODIPY™, boron dipyrromethene difluoride, 
Oregon Green, MITOTRACKER™ Red, DiOC7(3), DilCig, 
Phycoerythrin, Phycobiliproteins BPE (240 kDa) RPE (240 kDa) CPC (264 
kDa) APC (104 kDa), Spectrum Blue, Spectrum Aqua, Spectrum Green, 
Spectrum Gold, Spectrum Orange, Spectrum Red, NADH, NADPH, FAD, 
Infra-Red (IR) Dyes, Cyclic GDP-Ribose (cGDPR), Calcofluor White, 
Tyrosine and Tryptophan. 

21. The method of claim 18, wherein said detectable moiety is a 
non-fluorescent dye. 
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22. The method of claim 21, wherein said non- fluorescent dye is 
selected from the group consisting of alkaline phosphatase, horseradish » 
peroxidase, glucose oxidase and beta-galactosidase substrates. 

23. The method of claim 18, wherein said detectable moiety is an 
enzyme catalyzing a colorimetric reaction of a substrate having a 
substantially non-soluble color reaction product. 

24. The method of claim 23, wherein said enzyme is selected 
from the group consisting of alkaline phosphatase, horseradish peroxidase, 
P-galactosidase, and glucose oxidase. 

25. The method of claim 23, wherein said substrate is selected 
from the group consisting of alkaline phosphatase, horseradish peroxidase, 
P-galactosidase, and glucose oxidase substrates. 

26. The method of claim 18, wherein said detectable moiety is an 
enzyme catalyzing a luminescence reaction of a substrate having a 
substantially non-soluble reaction.product capable of luminescencing or of 
directing a second reaction of a second substrate having a luminescencing 
product. 

27. The method of claim 26, wherein said enzyme is selected 
from the group consisting of luciferase and aequorin. 

28. The method of claim 26, wherein said first and second 
substrates are each independently selected from the group consisting of 
luciferine, ATP, coelenterazine and Ca"*^. 

29. The method of claim 1, wherein said first and second 
histological stains are each independently selected from the group 
consisting of 4\6-diamidino-2-phenylindole, Eosin, Fluorescein 
isothiocyanate, Hoechst 33258, Hoechst 33342, Propidium Iodide, 
Quinacrine, Fluorescein-phalloidin, Resorufin, hematoxylin, Orange G, 
Light Green SF, Romanowsky-Giemsa, May-Grunwald, Blue counterstain, 
ethyl green, Feulgen-naphthol yellow S, Giemsa, Methylene Blue, Methyl 
Green, pyronin, Naphthol-yellow, Neutral Red, Papanicolaou stain, Red 
Counterstain C and Sirius Red. 



WO 00/06774 PCT/US99/16629 

85 

30. The method of claim 1, wherein said first and second DNA * - 
ploidy stains are each independently selected from the group consisting of 
Chromomycin A 3, DAPI, Acriflavine-Feulgen reaction, Auramine O- 
Feulgen reaction, Ethidium Bromide, Propidium iodide, high affinity DNA 
fluorophores, Green Fluorescent Protein fused to DNA binding protein, 
ACMA, Quinacrine and Acridine Orange, Feulgen reagent, Gallocyanin 
chrom-alum, Gallocyanin chrom-alum and naphthol yellow S, Methyl 
green-pyronin Y and Thionin-Feulgen reagent. 

31. A method of in situ analysis of a biological sample 
comprising the steps of: 

(a) staining the biological sample with a plurality of stains of 
which a first stain is selected from the group consisting of a 
first immunohistochemical stain, a first histological stain and a 
first DNA ploidy stain, and a second stain is selected from the 
group consisting of a second immunohistochemical stain, a 
second histological stain and a second DNA ploidy stain, with 
a provision that: 

(i) if said first stain is said first immunohistochemical stain 
then said second stain is either said second histological 
stain or said second DNA ploidy stain; 

(ii) if said first stain is said first histological stain then said 
second stain is either said second immunohistochemical 
stain or said second DNA ploidy stain; whereas 

(iii) if said first stain is said first DNA ploidy stain then said 
second stain is either said second immunohistochemical 
stain or said second histological stain; and 

(b) using a spectral data collection device for collecting spectral 
data from said biological sample, said spectral data collection 
device and said plurality of stains are selected such that a 
spectral component associated with each of said plurality of 
stains is collectable. 

32. The method of claim 3 1 , wherein said spectral data collection 
device is selected from the group consisting of an interferometer-based 
spectral data collection device, filters-based spectral data collection device 
and a dispersion element-based spectral data collection device. 
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33. The method of claim 31, wherein said first and second * - 
immunohistochemical stains each independently includes a primary 
antibody. 

34. The method of claim 33, wherein said primary antibody is 
selected from the group consisting of anti-estrogen receptor antibody, anti- 
progesterone receptor antibody, anti-p53 antibody, anti-Her-2/neu antibody, 
anti-EGFR antibody, anti-cathepsin D antibody, anti-Bcl-2 antibody, anti-E- 
cadherin antibody, anti-CA125 antibody, anti-CA15-3 antibody, anti-CA19- 
9 antibody, anti-c-erbB-2 antibody, anti-P-glycoprotein antibody, anti-CEA 
antibody, anti-retinoblastoma protein antibody, anti-ras oncoprotein 
antibody, anti-Lewis X antibody, anti-Ki-67 antibody, anti-PCNA antibody, 
anti-CD3 antibody, anti-CD4 antibody, anti-CD5 antibody, anti-CD7 
antibody, anti-CD8 antibody, anti-CD9/p24 antibody, anti-CD 10 antibody, 
anti-CDllc antibody, anti-CD13 antibody, anti-CD14 antibody, anti-CD15 
antibody, anti-CD19 antibody, anti-CD20 antibody, anti-CD22 antibody, 
anti-CD23 antibody, anti-CD30 antibody, anti-CD31 antibody, anti-CD33 
antibody, anti-CD34 antibody, anti-CD35 antibody, anti-CD38 antibody, 
anti-CD41 antibody, anti-LCA/CD45 antibody, anti-CD45RO antibody, 
anti-CD45RA antibody, anti-CD39 antibody, anti-CDIOO antibody, anti- 

~ CD95/Fas antibody, anti-CD99 antibody, anti-CD106 antibody, anti- 
ubiquitin antibody, anti-CD71 antibody, anti-c-myc antibody, anti- 
cytokeratins antibody, anti-vimentins antibody, anti-HPV proteins antibody, 
anti-kappa light chains antibody, anti-lambda light chains antibody, anti- 
melanosomes antibody, anti-prostate specific antigen antibody, anti-S-100 
antibody, anti-tau antigen antibody, anti-fibrin antibody, anti-keratins 
antibody and anti-Tn-antigen antibody. 

35. The method of claim 33, wherein said primary antibody is 
labeled with a detectable moiety. 

36. The method of claim 35, wherein said detectable moiety is a 
fluorescent dye. 



37. The method of claim 36, wherein said fluorescent dye is 
selected from the group consisting of Fluorescein, Rhodamine, Texas Red, 
Cy2, Cy3, Cy5, VECTOR Red, ELF™ (Enzyme-Labeled Fluorescence), 
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CyO, Cy0.5, Cyl, Cyl.5, Cy3, Cy3.5, Gy5, Cy7, FluorX, Calcein, Calcein- 
AM, CRYPTOFLUOR™'S, Orange (42 kDa), Tangerine (35 kDa), Gold * - 
(31 kDa), Red (42 kDa), Crimson (40 kDa), BHMP, BHDMAP, Br-Oregon, 
Lucifer Yellow, Alexa dye family, N-[6-(7-nitrobenz-2-oxa-l, 3-diazol-4- 
yl)amino]caproyl] (NBD), BODIPY™, boron dipyrromethene difluoride, 
Oregon Green, MITOTRACKER™ Red, DiOC7(3), DiICi8, 
Phycoerythrin, Phycobiliproteins BPE (240 kDa) RPE (240 kDa) CPC (264 
kDa) APC (104 kDa), Spectrum Blue,. Spectrum Aqua, Spectrum Green, 
Spectrum Gold, Spectrum Orange, Spectrum Red, NADH, NADPH, FAD, 
Infra-Red (IR) Dyes, Cyclic GDP-Ribose (cGDPR), Calcofluor White, 
Tyrosine and Tryptophan. 

38. The method of claim 35, wherein said detectable moiety is a 
non- fluorescent dye. 

39. The method of claim 38, wherein said non-fluorescent dye 
includes a heavy metal. 

40. The method of claim 35, wherein said detectable moiety is an 
enzyme catalyzing a colorimetric reaction of a substrate having a 
substantially non-soluble color reaction product. 

41. The method of claim 40, wherein said enzyme is selected 
from the group consisting of alkaline phosphatase, horseradish peroxidase, 
P-galactosidase, and glucose oxidase. 

42. The method of claim 40, wherein said substrate is selected 
from the group consisting of alkaline phosphatase substrates, horseradish 
peroxidase substrates, glucose oxidase substrates and beta-galactosidase 
substrates. 

43. The method of claim 35, wherein said detectable moiety is an 
enzyme catalyzing a luminescence reaction of a substrate having a 
substantially non-soluble reaction product capable of luminescencing or of 
chemical involvement in a second reaction with at least one additional 
substrate, said second reaction having a luminescencing product. 
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44. The method of claim 43, wherein said enzyme is selected 
from the group consisting of alkaline phosphatase, horseradish peroxidase, » 
P-galactosidase and glucose oxidase. 

45. The method of claim 43, wherein said first and at least one 
additional substrates are each independently selected from the group 
consisting of alkaline phosphatase, horseradish peroxidase, p-galactosidase 
and glucose oxidase substrates. 

46. The method of claim 31, wherein said first and second 
immunohistochemical stains each independently includes a primary 
antibody and a signal amplification mechanism. 

47. The method of claim 46, wherein said signal amplification 
mechanism is selected from the group consisting of a secondary antibody 
capable of binding a constant region of said primary antibody, avidin or 
strepavidin capable of binding biotin conjugated to said primary antibody 
and biotin capable of binding avidin or strepavidin conjugated to said 
primary antibody. 

48. The method of claim 44, wherein said secondary antibody, 
avidin, strepavidin and biotin are each independently labeled with a 
detectable moiety. 

49. The method of claim 48, wherein said detectable moiety is a 
fluorescent dye. 

50. The method of claim 49, wherein said fluorescent dye is 
selected from the group consisting of Fluorescein, Rhodamine, Texas Red, 
Cy2, Cy3, Cy5, VECTOR Red, ELF™ (Enzyme-Labeled Fluorescence), 
Cyo', Cy0.5, Cyl, Cyl.5, Cy3, Cy3.5, Cy5, Cy7, FluorX, Calcein, Calcein- 
AM, CRYPTOFLUOR™'S, Orange (42 kDa), Tangerine (35 kDa), Gold 
(31 kDa), Red (42 kDa), Crimson (40 kDa), BHMP, BHDMAP, Br-Oregon, 
Lucifer Yellow, Alexa dye family, N-[6-(7-nitrobenz-2-oxa-l, 3-diazol-4- 
yl)amino]caproyl] (NBD), BODIPY™, boron dipyrromethene difluoride, 
Oregon Green, MITOTRACKER™ Red, DiOC 7 (3), DilCig, 
Phycoerythrin, Phycobiliproteins BPE (240 kDa) RPE (240 kDa) CPC (264 
kDa) APC (104 kDa), Spectrum Blue, Spectrum Aqua, Spectrum Green, 
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Spectrum Gold, Spectrum Orange, Spectrum Red, NADH, NADPH, FAD, 
Infra-Red (IR) Dyes, Cyclic GDP-Ribose (cGDPR), Calcofluor White, . 
Tyrosine and Tryptophan. 

51. The method of claim 48, wherein said detectable moiety is a 
non-fluorescent dye. 

52. The method of claim 51, wherein said non-fluorescent dye is 
selected from the group consisting of alkaline phosphatase, horseradish 
peroxidase, glucose oxidase and beta-galactosidase substrates. 

53 . The method of claim 48, wherein said detectable moiety is an 
enzyme catalyzing a colorimetric reaction of a substrate having a 
substantially non-soluble color reaction product. 

54. The method of claim 53, wherein said enzyme is selected 
from the group consisting of alkaline phosphatase, horseradish peroxidase, 
P-galactosidase, and glucose oxidase. 

55. The method of claim 53, wherein said substrate is selected 
from the group consisting of alkaline phosphatase, horseradish peroxidase, 
P-galactosidase, and glucose oxidase substrates. 

56. The method of claim 48, wherein said detectable moiety is an 
enzyme catalyzing a luminescence reaction of a substrate having a 
substantially non-soluble reaction product capable of luminescencing or of 
directing a second reaction of a second substrate having a luminescencing 
product. 

57. The method of claim 56, wherein said enzyme is selected 
from the group consisting of luciferase and aequorin. 

58. The method of claim 56, wherein said first and second 
substrates are each independently selected from the group consisting of 
luciferine, ATP, coelenterazine and Ca"^. 

59. The method of claim 31, wherein said first and second 
histological stains are each independently selected from the group 
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consisting of 4\6-diamidino-2-phenylindole, Eosin, Fluorescein 
isothiocyanate, Hoechst 33258, Hoechst 33342, Propidium Iodide, 
Quinacrine, Fluorescein-phalloidin, Resorufin, hematoxylin, Orange G, 
Light Green SF, Romanowsky-Giemsa, May-Grunwald, Blue counterstain, 
ethyl green, Feulgen-naphthol yellow S, Giemsa, Methylene Blue, Methyl 
Green, pyronin, Naphthol-yellow, Neutral Red, Papanicolaou stain, Red 
Counterstain C and Sirius Red. 

60. A method of in situ analysis of a biological sample 
comprising the steps of: 

(a) staining the biological sample with at least four different 
immunohistochemical stains; and 

(b) using a spectral data collection device for collecting spectral 
data from said biological sample, said spectral data collection 
device and said at least four immunohistochemical stains are 
selected such that a spectral component associated with each 
of said at least four immunohistochemical stains is collectable. 

61. A method of in situ analysis of a biological sample 

comprising the steps of: 

(a) staining the biological sample with at least three stains of 
which at least one stain is an immunohistochemical stain and 
at least one additional stain is a histological stain or a DNA 
ploidy stain; and 

(b) using a spectral data collection device for collecting spectral 
data from said biological sample, said spectral data collection 
device and said at least three stains are selected such that a 
spectral component associated with each of said at least three 
stains is collectable. 

62. A method of in situ analysis of a biological sample 

comprising the steps of: 

(a) staining the biological sample with at least three stains of 
which a first stain is an immunohistochemical stain, a second 
stain is a histological stain and a third stain is a DNA ploidy 
stain; and 

(b) using a spectral data collection device for collecting spectral 
data from said biological sample, said spectral data collection 
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device and said at least three stains are selected such that a 
spectral component specifically associated with each of said at * - 
least three stains is collectable. 



63. An immunohistochemical composition comprising at least 
four different immunohistochemical stains, each being for staining a 
respective cytological marker and each being individually detectable in a 
presence of all others using a spectral data collection device. 
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